-
- Downloads
[SPARK-4277] Support external shuffle service on Standalone Worker
Author: Aaron Davidson <aaron@databricks.com> Closes #3142 from aarondav/worker and squashes the following commits: 3780bd7 [Aaron Davidson] Address comments 2dcdfc1 [Aaron Davidson] Add private[worker] 47f49d3 [Aaron Davidson] NettyBlockTransferService shouldn't care about app ids (it's only b/t executors) 258417c [Aaron Davidson] [SPARK-4277] Support external shuffle service on executor
Showing
- core/src/main/scala/org/apache/spark/SecurityManager.scala 3 additions, 11 deletionscore/src/main/scala/org/apache/spark/SecurityManager.scala
- core/src/main/scala/org/apache/spark/deploy/worker/StandaloneWorkerShuffleService.scala 66 additions, 0 deletions.../spark/deploy/worker/StandaloneWorkerShuffleService.scala
- core/src/main/scala/org/apache/spark/deploy/worker/Worker.scala 7 additions, 1 deletion...rc/main/scala/org/apache/spark/deploy/worker/Worker.scala
- core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala 1 addition, 1 deletion...rg/apache/spark/storage/ShuffleBlockFetcherIterator.scala
- core/src/test/scala/org/apache/spark/network/netty/NettyBlockTransferSecuritySuite.scala 0 additions, 12 deletions...spark/network/netty/NettyBlockTransferSecuritySuite.scala
- network/shuffle/src/main/java/org/apache/spark/network/sasl/SaslMessage.java 2 additions, 1 deletion.../main/java/org/apache/spark/network/sasl/SaslMessage.java
Loading
Please register or sign in to comment