-
- Downloads
[SPARK-4080] Only throw IOException from [write|read][Object|External]
If classes implementing Serializable or Externalizable interfaces throw exceptions other than IOException or ClassNotFoundException from their (de)serialization methods, then this results in an unhelpful "IOException: unexpected exception type" rather than the actual exception that produced the (de)serialization error. This patch fixes this by adding a utility method that re-wraps any uncaught exceptions in IOException (unless they are already instances of IOException). Author: Josh Rosen <joshrosen@databricks.com> Closes #2932 from JoshRosen/SPARK-4080 and squashes the following commits: cd3a9be [Josh Rosen] [SPARK-4080] Only throw IOException from [write|read][Object|External].
Showing
- core/src/main/scala/org/apache/spark/Accumulators.scala 2 additions, 1 deletioncore/src/main/scala/org/apache/spark/Accumulators.scala
- core/src/main/scala/org/apache/spark/Partitioner.scala 2 additions, 2 deletionscore/src/main/scala/org/apache/spark/Partitioner.scala
- core/src/main/scala/org/apache/spark/SerializableWritable.scala 3 additions, 2 deletions...rc/main/scala/org/apache/spark/SerializableWritable.scala
- core/src/main/scala/org/apache/spark/broadcast/HttpBroadcast.scala 2 additions, 2 deletions...main/scala/org/apache/spark/broadcast/HttpBroadcast.scala
- core/src/main/scala/org/apache/spark/broadcast/TorrentBroadcast.scala 3 additions, 3 deletions...n/scala/org/apache/spark/broadcast/TorrentBroadcast.scala
- core/src/main/scala/org/apache/spark/deploy/master/ApplicationInfo.scala 2 additions, 1 deletion...cala/org/apache/spark/deploy/master/ApplicationInfo.scala
- core/src/main/scala/org/apache/spark/deploy/master/DriverInfo.scala 2 additions, 1 deletion...ain/scala/org/apache/spark/deploy/master/DriverInfo.scala
- core/src/main/scala/org/apache/spark/deploy/master/WorkerInfo.scala 1 addition, 1 deletion...ain/scala/org/apache/spark/deploy/master/WorkerInfo.scala
- core/src/main/scala/org/apache/spark/rdd/CartesianRDD.scala 2 additions, 1 deletioncore/src/main/scala/org/apache/spark/rdd/CartesianRDD.scala
- core/src/main/scala/org/apache/spark/rdd/CoGroupedRDD.scala 2 additions, 1 deletioncore/src/main/scala/org/apache/spark/rdd/CoGroupedRDD.scala
- core/src/main/scala/org/apache/spark/rdd/CoalescedRDD.scala 2 additions, 1 deletioncore/src/main/scala/org/apache/spark/rdd/CoalescedRDD.scala
- core/src/main/scala/org/apache/spark/rdd/ParallelCollectionRDD.scala 2 additions, 2 deletions...in/scala/org/apache/spark/rdd/ParallelCollectionRDD.scala
- core/src/main/scala/org/apache/spark/rdd/PartitionerAwareUnionRDD.scala 2 additions, 1 deletion...scala/org/apache/spark/rdd/PartitionerAwareUnionRDD.scala
- core/src/main/scala/org/apache/spark/rdd/UnionRDD.scala 2 additions, 1 deletioncore/src/main/scala/org/apache/spark/rdd/UnionRDD.scala
- core/src/main/scala/org/apache/spark/rdd/ZippedPartitionsRDD.scala 2 additions, 1 deletion...main/scala/org/apache/spark/rdd/ZippedPartitionsRDD.scala
- core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala 5 additions, 4 deletions...src/main/scala/org/apache/spark/scheduler/MapStatus.scala
- core/src/main/scala/org/apache/spark/scheduler/TaskResult.scala 2 additions, 2 deletions...rc/main/scala/org/apache/spark/scheduler/TaskResult.scala
- core/src/main/scala/org/apache/spark/serializer/JavaSerializer.scala 2 additions, 2 deletions...in/scala/org/apache/spark/serializer/JavaSerializer.scala
- core/src/main/scala/org/apache/spark/storage/BlockManagerId.scala 2 additions, 2 deletions.../main/scala/org/apache/spark/storage/BlockManagerId.scala
- core/src/main/scala/org/apache/spark/storage/BlockManagerMessages.scala 4 additions, 2 deletions...scala/org/apache/spark/storage/BlockManagerMessages.scala
Loading
Please register or sign in to comment