-
- Downloads
[SPARK-6287] [MESOS] Add dynamic allocation to the coarse-grained Mesos scheduler
This is largely based on extracting the dynamic allocation parts from tnachen's #3861. Author: Iulian Dragos <jaguarul@gmail.com> Closes #4984 from dragos/issue/mesos-coarse-dynamicAllocation and squashes the following commits: 39df8cd [Iulian Dragos] Update tests to latest changes in core. 9d2c9fa [Iulian Dragos] Remove adjustment of executorLimitOption in doKillExecutors. 8b00f52 [Iulian Dragos] Latest round of reviews. 0cd00e0 [Iulian Dragos] Add persistent shuffle directory 15c45c1 [Iulian Dragos] Add dynamic allocation to the Spark coarse-grained scheduler.
Showing
- core/src/main/scala/org/apache/spark/SparkContext.scala 11 additions, 8 deletionscore/src/main/scala/org/apache/spark/SparkContext.scala
- core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala 110 additions, 26 deletions...scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala
- core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala 2 additions, 2 deletions...e/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala
- core/src/main/scala/org/apache/spark/storage/DiskBlockManager.scala 7 additions, 1 deletion...ain/scala/org/apache/spark/storage/DiskBlockManager.scala
- core/src/main/scala/org/apache/spark/util/Utils.scala 26 additions, 19 deletionscore/src/main/scala/org/apache/spark/util/Utils.scala
- core/src/test/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackendSuite.scala 175 additions, 0 deletions...uler/cluster/mesos/CoarseMesosSchedulerBackendSuite.scala
Loading
Please register or sign in to comment