-
- Downloads
[SPARK-18617][CORE][STREAMING] Close "kryo auto pick" feature for Spark Streaming
## What changes were proposed in this pull request? #15992 provided a solution to fix the bug, i.e. **receiver data can not be deserialized properly**. As zsxwing said, it is a critical bug, but we should not break APIs between maintenance releases. It may be a rational choice to close auto pick kryo serializer for Spark Streaming in the first step. I will continue #15992 to optimize the solution. ## How was this patch tested? existing ut Author: uncleGen <hustyugm@gmail.com> Closes #16052 from uncleGen/SPARK-18617. (cherry picked from commit 56c82eda) Signed-off-by:Reynold Xin <rxin@databricks.com>
Showing
- core/src/main/scala/org/apache/spark/serializer/SerializerManager.scala 11 additions, 5 deletions...scala/org/apache/spark/serializer/SerializerManager.scala
- core/src/main/scala/org/apache/spark/storage/memory/MemoryStore.scala 3 additions, 2 deletions...n/scala/org/apache/spark/storage/memory/MemoryStore.scala
- core/src/test/scala/org/apache/spark/storage/PartiallySerializedBlockSuite.scala 4 additions, 2 deletions.../apache/spark/storage/PartiallySerializedBlockSuite.scala
- streaming/src/test/scala/org/apache/spark/streaming/StreamingContextSuite.scala 47 additions, 0 deletions...la/org/apache/spark/streaming/StreamingContextSuite.scala
Loading
Please register or sign in to comment