-
- Downloads
[SPARK-6955] Perform port retries at NettyBlockTransferService level
Currently we're doing port retries in the TransportServer level, but this is not specified by the TransportContext API and it has other further-reaching impacts like causing undesirable behavior for the Yarn and Standalone shuffle services. Author: Aaron Davidson <aaron@databricks.com> Closes #5575 from aarondav/port-bind and squashes the following commits: 3c2d6ed [Aaron Davidson] Oops, never do it. a5d9432 [Aaron Davidson] Remove shouldHostShuffleServiceIfEnabled e901eb2 [Aaron Davidson] fix local-cluster mode for ExternalShuffleServiceSuite 59e5e38 [Aaron Davidson] [SPARK-6955] Perform port retries at NettyBlockTransferService level
Showing
- core/src/main/scala/org/apache/spark/deploy/LocalSparkCluster.scala 3 additions, 1 deletion...ain/scala/org/apache/spark/deploy/LocalSparkCluster.scala
- core/src/main/scala/org/apache/spark/network/netty/NettyBlockTransferService.scala 12 additions, 2 deletions...pache/spark/network/netty/NettyBlockTransferService.scala
- core/src/test/scala/org/apache/spark/network/netty/NettyBlockTransferServiceSuite.scala 78 additions, 0 deletions.../spark/network/netty/NettyBlockTransferServiceSuite.scala
- network/common/src/main/java/org/apache/spark/network/server/TransportServer.java 9 additions, 36 deletions...java/org/apache/spark/network/server/TransportServer.java
Loading
Please register or sign in to comment