-
- Downloads
[SPARK-7103] Fix crash with SparkContext.union when RDD has no partitioner
Added a check to the SparkContext.union method to check that a partitioner is defined on all RDDs when instantiating a PartitionerAwareUnionRDD. Author: Steven She <steven@canopylabs.com> Closes #5679 from stevencanopy/SPARK-7103 and squashes the following commits: 5a3d846 [Steven She] SPARK-7103: Fix crash with SparkContext.union when at least one RDD has no partitioner
Showing
- core/src/main/scala/org/apache/spark/SparkContext.scala 1 addition, 1 deletioncore/src/main/scala/org/apache/spark/SparkContext.scala
- core/src/main/scala/org/apache/spark/rdd/PartitionerAwareUnionRDD.scala 1 addition, 0 deletions...scala/org/apache/spark/rdd/PartitionerAwareUnionRDD.scala
- core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala 21 additions, 0 deletionscore/src/test/scala/org/apache/spark/rdd/RDDSuite.scala
Loading
Please register or sign in to comment