-
- Downloads
[SPARK-4719][API] Consolidate various narrow dep RDD classes with MapPartitionsRDD
MappedRDD, MappedValuesRDD, FlatMappedValuesRDD, FilteredRDD, GlommedRDD, FlatMappedRDD are not necessary. They can be implemented trivially using MapPartitionsRDD. Author: Reynold Xin <rxin@databricks.com> Closes #3578 from rxin/SPARK-4719 and squashes the following commits: eed9853 [Reynold Xin] Preserve partitioning for filter. eb1a89b [Reynold Xin] [SPARK-4719][API] Consolidate various narrow dep RDD classes with MapPartitionsRDD.
Showing
- core/src/main/scala/org/apache/spark/rdd/BinaryFileRDD.scala 6 additions, 6 deletionscore/src/main/scala/org/apache/spark/rdd/BinaryFileRDD.scala
- core/src/main/scala/org/apache/spark/rdd/FilteredRDD.scala 0 additions, 35 deletionscore/src/main/scala/org/apache/spark/rdd/FilteredRDD.scala
- core/src/main/scala/org/apache/spark/rdd/FlatMappedRDD.scala 0 additions, 34 deletionscore/src/main/scala/org/apache/spark/rdd/FlatMappedRDD.scala
- core/src/main/scala/org/apache/spark/rdd/FlatMappedValuesRDD.scala 0 additions, 35 deletions...main/scala/org/apache/spark/rdd/FlatMappedValuesRDD.scala
- core/src/main/scala/org/apache/spark/rdd/GlommedRDD.scala 0 additions, 31 deletionscore/src/main/scala/org/apache/spark/rdd/GlommedRDD.scala
- core/src/main/scala/org/apache/spark/rdd/MappedRDD.scala 0 additions, 32 deletionscore/src/main/scala/org/apache/spark/rdd/MappedRDD.scala
- core/src/main/scala/org/apache/spark/rdd/MappedValuesRDD.scala 0 additions, 33 deletions...src/main/scala/org/apache/spark/rdd/MappedValuesRDD.scala
- core/src/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala 8 additions, 2 deletions...rc/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala
- core/src/main/scala/org/apache/spark/rdd/RDD.scala 20 additions, 8 deletionscore/src/main/scala/org/apache/spark/rdd/RDD.scala
- core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala 21 additions, 29 deletionscore/src/test/scala/org/apache/spark/rdd/RDDSuite.scala
Loading
Please register or sign in to comment