Skip to content
  • Ivan Wick's avatar
    5cd11d51
    Set spark.executor.uri from environment variable (needed by Mesos) · 5cd11d51
    Ivan Wick authored
    The Mesos backend uses this property when setting up a slave process.  It is similarly set in the Scala repl (org.apache.spark.repl.SparkILoop), but I couldn't find any analogous for pyspark.
    
    Author: Ivan Wick <ivanwick+github@gmail.com>
    
    This patch had conflicts when merged, resolved by
    Committer: Matei Zaharia <matei@databricks.com>
    
    Closes #311 from ivanwick/master and squashes the following commits:
    
    da0c3e4 [Ivan Wick] Set spark.executor.uri from environment variable (needed by Mesos)
    5cd11d51
    Set spark.executor.uri from environment variable (needed by Mesos)
    Ivan Wick authored
    The Mesos backend uses this property when setting up a slave process.  It is similarly set in the Scala repl (org.apache.spark.repl.SparkILoop), but I couldn't find any analogous for pyspark.
    
    Author: Ivan Wick <ivanwick+github@gmail.com>
    
    This patch had conflicts when merged, resolved by
    Committer: Matei Zaharia <matei@databricks.com>
    
    Closes #311 from ivanwick/master and squashes the following commits:
    
    da0c3e4 [Ivan Wick] Set spark.executor.uri from environment variable (needed by Mesos)
Loading