-
- Downloads
[SPARK-18972][CORE] Fix the netty thread names for RPC
## What changes were proposed in this pull request? Right now the name of threads created by Netty for Spark RPC are `shuffle-client-**` and `shuffle-server-**`. It's pretty confusing. This PR just uses the module name in TransportConf to set the thread name. In addition, it also includes the following minor fixes: - TransportChannelHandler.channelActive and channelInactive should call the corresponding super methods. - Make ShuffleBlockFetcherIterator throw NoSuchElementException if it has no more elements. Otherwise, if the caller calls `next` without `hasNext`, it will just hang. ## How was this patch tested? Jenkins Author: Shixiong Zhu <shixiong@databricks.com> Closes #16380 from zsxwing/SPARK-18972.
Showing
- common/network-common/src/main/java/org/apache/spark/network/client/TransportClientFactory.java 4 additions, 2 deletions...g/apache/spark/network/client/TransportClientFactory.java
- common/network-common/src/main/java/org/apache/spark/network/server/TransportChannelHandler.java 6 additions, 6 deletions.../apache/spark/network/server/TransportChannelHandler.java
- common/network-common/src/main/java/org/apache/spark/network/server/TransportServer.java 1 addition, 1 deletion...java/org/apache/spark/network/server/TransportServer.java
- common/network-common/src/main/java/org/apache/spark/network/util/TransportConf.java 4 additions, 0 deletions...ain/java/org/apache/spark/network/util/TransportConf.java
- core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala 4 additions, 0 deletions...rg/apache/spark/storage/ShuffleBlockFetcherIterator.scala
Loading
Please register or sign in to comment