-
- Downloads
[SPARK-9943] [SQL] deserialized UnsafeHashedRelation should be serializable
When the free memory in executor goes low, the cached broadcast objects need to serialized into disk, but currently the deserialized UnsafeHashedRelation can't be serialized , fail with NPE. This PR fixes that. cc rxin Author: Davies Liu <davies@databricks.com> Closes #8174 from davies/serialize_hashed.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/execution/joins/HashedRelation.scala 60 additions, 33 deletions...org/apache/spark/sql/execution/joins/HashedRelation.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/joins/HashedRelationSuite.scala 14 additions, 0 deletions...pache/spark/sql/execution/joins/HashedRelationSuite.scala
Loading
Please register or sign in to comment