-
- Downloads
CustomBlockedLocalFileShuffle: reducers are reading multiple blocks per...
CustomBlockedLocalFileShuffle: reducers are reading multiple blocks per connections instead of just one. Sometimes ShuffleServer fails to start for small shuffle data with small block size in local VM. No problem with large block size.
Showing
- conf/java-opts 1 addition, 1 deletionconf/java-opts
- src/scala/spark/CustomBlockedInMemoryShuffle.scala 3 additions, 3 deletionssrc/scala/spark/CustomBlockedInMemoryShuffle.scala
- src/scala/spark/CustomBlockedLocalFileShuffle.scala 129 additions, 103 deletionssrc/scala/spark/CustomBlockedLocalFileShuffle.scala
- src/scala/spark/Shuffle.scala 9 additions, 0 deletionssrc/scala/spark/Shuffle.scala
- src/scala/spark/TrackedCustomBlockedLocalFileShuffle.scala 3 additions, 3 deletionssrc/scala/spark/TrackedCustomBlockedLocalFileShuffle.scala
Loading
Please register or sign in to comment