-
- Downloads
Refactor ShuffleBlockManager to reduce public interface
- ShuffleBlocks has been removed and replaced by ShuffleWriterGroup. - ShuffleWriterGroup no longer contains a reference to a ShuffleFileGroup. - ShuffleFile has been removed and its contents are now within ShuffleFileGroup. - ShuffleBlockManager.forShuffle has been replaced by a more stateful forMapTask.
Showing
- core/src/main/scala/org/apache/spark/scheduler/ShuffleMapTask.scala 10 additions, 11 deletions...ain/scala/org/apache/spark/scheduler/ShuffleMapTask.scala
- core/src/main/scala/org/apache/spark/storage/ShuffleBlockManager.scala 108 additions, 162 deletions.../scala/org/apache/spark/storage/ShuffleBlockManager.scala
- core/src/main/scala/org/apache/spark/storage/StoragePerfTester.scala 5 additions, 5 deletions...in/scala/org/apache/spark/storage/StoragePerfTester.scala
Loading
Please register or sign in to comment