-
- Downloads
[SPARK-20812][MESOS] Add secrets support to the dispatcher
Mesos has secrets primitives for environment and file-based secrets, this PR adds that functionality to the Spark dispatcher and the appropriate configuration flags. Unit tested and manually tested against a DC/OS cluster with Mesos 1.4. Author: ArtRand <arand@soe.ucsc.edu> Closes #18837 from ArtRand/spark-20812-dispatcher-secrets-and-labels.
Showing
- dev/deps/spark-deps-hadoop-2.6 1 addition, 1 deletiondev/deps/spark-deps-hadoop-2.6
- dev/deps/spark-deps-hadoop-2.7 1 addition, 1 deletiondev/deps/spark-deps-hadoop-2.7
- docs/running-on-mesos.md 41 additions, 2 deletionsdocs/running-on-mesos.md
- docs/security.md 3 additions, 0 deletionsdocs/security.md
- resource-managers/mesos/pom.xml 1 addition, 1 deletionresource-managers/mesos/pom.xml
- resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/config.scala 32 additions, 1 deletion...src/main/scala/org/apache/spark/deploy/mesos/config.scala
- resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala 131 additions, 5 deletions...spark/scheduler/cluster/mesos/MesosClusterScheduler.scala
- resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala 3 additions, 4 deletions...k/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala
- resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala 12 additions, 4 deletions...e/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala
- resource-managers/mesos/src/test/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterSchedulerSuite.scala 161 additions, 1 deletion.../scheduler/cluster/mesos/MesosClusterSchedulerSuite.scala
Loading
Please register or sign in to comment