-
- Downloads
[SPARK-11063] [STREAMING] Change preferredLocations of Receiver's RDD to hosts...
[SPARK-11063] [STREAMING] Change preferredLocations of Receiver's RDD to hosts rather than hostports The format of RDD's preferredLocations must be hostname but the format of Streaming Receiver's scheduling executors is hostport. So it doesn't work. This PR converts `schedulerExecutors` to `hosts` before creating Receiver's RDD. Author: zsxwing <zsxwing@gmail.com> Closes #9075 from zsxwing/SPARK-11063.
Showing
- streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverSchedulingPolicy.scala 2 additions, 1 deletion.../spark/streaming/scheduler/ReceiverSchedulingPolicy.scala
- streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverTracker.scala 3 additions, 1 deletion...rg/apache/spark/streaming/scheduler/ReceiverTracker.scala
- streaming/src/test/scala/org/apache/spark/streaming/scheduler/ReceiverTrackerSuite.scala 24 additions, 0 deletions...ache/spark/streaming/scheduler/ReceiverTrackerSuite.scala
Loading
Please register or sign in to comment