-
- Downloads
[SPARK-12130] Replace shuffleManagerClass with shortShuffleMgrNames in ExternalShuffleBlockResolver
Replace shuffleManagerClassName with shortShuffleMgrName is to reduce time of string's comparison. and put sort's comparison on the front. cc JoshRosen andrewor14 Author: Lianhui Wang <lianhuiwang09@gmail.com> Closes #10131 from lianhuiwang/spark-12130.
Showing
- core/src/main/scala/org/apache/spark/shuffle/ShuffleManager.scala 4 additions, 0 deletions.../main/scala/org/apache/spark/shuffle/ShuffleManager.scala
- core/src/main/scala/org/apache/spark/shuffle/hash/HashShuffleManager.scala 2 additions, 0 deletions...la/org/apache/spark/shuffle/hash/HashShuffleManager.scala
- core/src/main/scala/org/apache/spark/shuffle/sort/SortShuffleManager.scala 2 additions, 0 deletions...la/org/apache/spark/shuffle/sort/SortShuffleManager.scala
- core/src/main/scala/org/apache/spark/storage/BlockManager.scala 1 addition, 1 deletion...rc/main/scala/org/apache/spark/storage/BlockManager.scala
- network/shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockResolver.java 3 additions, 4 deletions...e/spark/network/shuffle/ExternalShuffleBlockResolver.java
- network/shuffle/src/test/java/org/apache/spark/network/sasl/SaslIntegrationSuite.java 1 addition, 2 deletions...a/org/apache/spark/network/sasl/SaslIntegrationSuite.java
- network/shuffle/src/test/java/org/apache/spark/network/shuffle/ExternalShuffleBlockResolverSuite.java 3 additions, 3 deletions...rk/network/shuffle/ExternalShuffleBlockResolverSuite.java
- network/shuffle/src/test/java/org/apache/spark/network/shuffle/ExternalShuffleIntegrationSuite.java 2 additions, 2 deletions...park/network/shuffle/ExternalShuffleIntegrationSuite.java
Loading
Please register or sign in to comment