-
- Downloads
[SPARK-12133][STREAMING] Streaming dynamic allocation
## What changes were proposed in this pull request? Added a new Executor Allocation Manager for the Streaming scheduler for doing Streaming Dynamic Allocation. ## How was this patch tested Unit tests, and cluster tests. Author: Tathagata Das <tathagata.das1565@gmail.com> Closes #12154 from tdas/streaming-dynamic-allocation.
Showing
- core/src/main/scala/org/apache/spark/ExecutorAllocationClient.scala 4 additions, 0 deletions...ain/scala/org/apache/spark/ExecutorAllocationClient.scala
- core/src/main/scala/org/apache/spark/SparkContext.scala 10 additions, 0 deletionscore/src/main/scala/org/apache/spark/SparkContext.scala
- core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala 4 additions, 0 deletions...ark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
- streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala 4 additions, 3 deletions...n/scala/org/apache/spark/streaming/StreamingContext.scala
- streaming/src/main/scala/org/apache/spark/streaming/scheduler/ExecutorAllocationManager.scala 233 additions, 0 deletions...spark/streaming/scheduler/ExecutorAllocationManager.scala
- streaming/src/main/scala/org/apache/spark/streaming/scheduler/JobScheduler.scala 14 additions, 0 deletions...a/org/apache/spark/streaming/scheduler/JobScheduler.scala
- streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverTracker.scala 19 additions, 0 deletions...rg/apache/spark/streaming/scheduler/ReceiverTracker.scala
- streaming/src/test/scala/org/apache/spark/streaming/scheduler/ExecutorAllocationManagerSuite.scala 395 additions, 0 deletions.../streaming/scheduler/ExecutorAllocationManagerSuite.scala
Loading
Please register or sign in to comment