Skip to content
Snippets Groups Projects
  • Aaron Davidson's avatar
    01cf4c40
    SPARK-1404: Always upgrade spark-env.sh vars to environment vars · 01cf4c40
    Aaron Davidson authored
    This was broken when spark-env.sh was made idempotent, as the idempotence check is an environment variable, but the spark-env.sh variables may not have been.
    
    Tested in zsh, bash, and sh.
    
    Author: Aaron Davidson <aaron@databricks.com>
    
    Closes #310 from aarondav/SPARK-1404 and squashes the following commits:
    
    c3406a5 [Aaron Davidson] Add extra export in spark-shell
    6a0e340 [Aaron Davidson] SPARK-1404: Always upgrade spark-env.sh vars to environment vars
    01cf4c40
    History
    SPARK-1404: Always upgrade spark-env.sh vars to environment vars
    Aaron Davidson authored
    This was broken when spark-env.sh was made idempotent, as the idempotence check is an environment variable, but the spark-env.sh variables may not have been.
    
    Tested in zsh, bash, and sh.
    
    Author: Aaron Davidson <aaron@databricks.com>
    
    Closes #310 from aarondav/SPARK-1404 and squashes the following commits:
    
    c3406a5 [Aaron Davidson] Add extra export in spark-shell
    6a0e340 [Aaron Davidson] SPARK-1404: Always upgrade spark-env.sh vars to environment vars