-
- Downloads
SPARK-2684: Update ExternalAppendOnlyMap to take an iterator as input
This will decrease object allocation from the "update" closure used in map.changeValue. Author: Matei Zaharia <matei@databricks.com> Closes #1607 from mateiz/spark-2684 and squashes the following commits: b7d89e6 [Matei Zaharia] Add insertAll for Iterables too, and fix some code style 561fc97 [Matei Zaharia] Update ExternalAppendOnlyMap to take an iterator as input
Showing
- core/src/main/scala/org/apache/spark/Aggregator.scala 1 addition, 4 deletionscore/src/main/scala/org/apache/spark/Aggregator.scala
- core/src/main/scala/org/apache/spark/rdd/CoGroupedRDD.scala 2 additions, 5 deletionscore/src/main/scala/org/apache/spark/rdd/CoGroupedRDD.scala
- core/src/main/scala/org/apache/spark/util/collection/ExternalAppendOnlyMap.scala 52 additions, 25 deletions.../apache/spark/util/collection/ExternalAppendOnlyMap.scala
- core/src/test/scala/org/apache/spark/util/collection/ExternalAppendOnlyMapSuite.scala 9 additions, 8 deletions...he/spark/util/collection/ExternalAppendOnlyMapSuite.scala
Loading
Please register or sign in to comment