Skip to content
Snippets Groups Projects
Commit 2bebaa39 authored by Michael Gummelt's avatar Michael Gummelt Committed by Kousuke Saruta
Browse files

[SPARK-12413] Fix Mesos ZK persistence

I believe this fixes SPARK-12413.  I'm currently running an integration test to verify.

Author: Michael Gummelt <mgummelt@mesosphere.io>

Closes #10366 from mgummelt/fix-zk-mesos.
parent 40e52a27
No related branches found
No related tags found
No related merge requests found
...@@ -99,7 +99,11 @@ private[mesos] class MesosSubmitRequestServlet( ...@@ -99,7 +99,11 @@ private[mesos] class MesosSubmitRequestServlet(
// cause spark-submit script to look for files in SPARK_HOME instead. // cause spark-submit script to look for files in SPARK_HOME instead.
// We only need the ability to specify where to find spark-submit script // We only need the ability to specify where to find spark-submit script
// which user can user spark.executor.home or spark.home configurations. // which user can user spark.executor.home or spark.home configurations.
val environmentVariables = request.environmentVariables.filterKeys(!_.equals("SPARK_HOME")) //
// Do not use `filterKeys` here to avoid SI-6654, which breaks ZK persistence
val environmentVariables = request.environmentVariables.filter { case (k, _) =>
k != "SPARK_HOME"
}
val name = request.sparkProperties.get("spark.app.name").getOrElse(mainClass) val name = request.sparkProperties.get("spark.app.name").getOrElse(mainClass)
// Construct driver description // Construct driver description
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment