-
- Downloads
SPARK-2893: Do not swallow Exceptions when running a custom kryo registrator
The previous behaviour of swallowing ClassNotFound exceptions when running a custom Kryo registrator could lead to difficult to debug problems later on at serialisation / deserialisation time, see SPARK-2878. Instead it is better to fail fast. Added test case. Author: Graham Dennis <graham.dennis@gmail.com> Closes #1827 from GrahamDennis/feature/spark-2893 and squashes the following commits: fbe4cb6 [Graham Dennis] [SPARK-2878]: Update the test case to match the updated exception message 65e53c5 [Graham Dennis] [SPARK-2893]: Improve message when a spark.kryo.registrator fails. f480d85 [Graham Dennis] [SPARK-2893] Fix typo. b59d2c2 [Graham Dennis] SPARK-2893: Do not swallow Exceptions when running a custom spark.kryo.registrator
Showing
- core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala 6 additions, 5 deletions...in/scala/org/apache/spark/serializer/KryoSerializer.scala
- core/src/test/scala/org/apache/spark/serializer/KryoSerializerSuite.scala 10 additions, 0 deletions...ala/org/apache/spark/serializer/KryoSerializerSuite.scala
Please register or sign in to comment