-
- Downloads
[SPARK-11096] Post-hoc review Netty based RPC implementation - round 2
A few more changes: 1. Renamed IDVerifier -> RpcEndpointVerifier 2. Renamed NettyRpcAddress -> RpcEndpointAddress 3. Simplified NettyRpcHandler a bit by removing the connection count tracking. This is OK because I now force spark.shuffle.io.numConnectionsPerPeer to 1 4. Reduced spark.rpc.connect.threads to 64. It would be great to eventually remove this extra thread pool. 5. Minor cleanup & documentation. Author: Reynold Xin <rxin@databricks.com> Closes #9112 from rxin/SPARK-11096.
Showing
- core/src/main/scala/org/apache/spark/rpc/RpcEnv.scala 0 additions, 9 deletionscore/src/main/scala/org/apache/spark/rpc/RpcEnv.scala
- core/src/main/scala/org/apache/spark/rpc/netty/Dispatcher.scala 5 additions, 2 deletions...rc/main/scala/org/apache/spark/rpc/netty/Dispatcher.scala
- core/src/main/scala/org/apache/spark/rpc/netty/NettyRpcEnv.scala 46 additions, 68 deletions...c/main/scala/org/apache/spark/rpc/netty/NettyRpcEnv.scala
- core/src/main/scala/org/apache/spark/rpc/netty/RpcEndpointAddress.scala 18 additions, 14 deletions...scala/org/apache/spark/rpc/netty/RpcEndpointAddress.scala
- core/src/main/scala/org/apache/spark/rpc/netty/RpcEndpointVerifier.scala 11 additions, 10 deletions...cala/org/apache/spark/rpc/netty/RpcEndpointVerifier.scala
- core/src/test/scala/org/apache/spark/rpc/netty/NettyRpcAddressSuite.scala 1 addition, 1 deletion...ala/org/apache/spark/rpc/netty/NettyRpcAddressSuite.scala
- core/src/test/scala/org/apache/spark/rpc/netty/NettyRpcHandlerSuite.scala 0 additions, 3 deletions...ala/org/apache/spark/rpc/netty/NettyRpcHandlerSuite.scala
Loading
Please register or sign in to comment