-
- Downloads
[SPARK-19702][MESOS] Increase default refuse_seconds timeout in the Mesos Spark Dispatcher
## What changes were proposed in this pull request? Increase default refuse_seconds timeout, and make it configurable. See JIRA for details on how this reduces the risk of starvation. ## How was this patch tested? Unit tests, Manual testing, and Mesos/Spark integration test suite cc susanxhuynh skonto jmlvanre Author: Michael Gummelt <mgummelt@mesosphere.io> Closes #17031 from mgummelt/SPARK-19702-suppress-revive.
Showing
- resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala 52 additions, 23 deletions...spark/scheduler/cluster/mesos/MesosClusterScheduler.scala
- resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala 29 additions, 40 deletions...er/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala
- resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosFineGrainedSchedulerBackend.scala 13 additions, 6 deletions...uler/cluster/mesos/MesosFineGrainedSchedulerBackend.scala
- resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala 47 additions, 13 deletions...e/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala
- resource-managers/mesos/src/test/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterSchedulerSuite.scala 33 additions, 18 deletions.../scheduler/cluster/mesos/MesosClusterSchedulerSuite.scala
- resource-managers/mesos/src/test/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackendSuite.scala 2 additions, 5 deletions...uster/mesos/MesosCoarseGrainedSchedulerBackendSuite.scala
- resource-managers/mesos/src/test/scala/org/apache/spark/scheduler/cluster/mesos/Utils.scala 11 additions, 0 deletions...cala/org/apache/spark/scheduler/cluster/mesos/Utils.scala
Loading
Please register or sign in to comment