Skip to content
Snippets Groups Projects
Commit 72ff62a3 authored by Matei Zaharia's avatar Matei Zaharia
Browse files

Two fixes to IPython support:

- Don't attempt to run worker processes with ipython (that can cause
  some crashes as ipython prints things to standard out)
- Allow passing some IPYTHON_OPTS to launch things like the notebook
parent f3d72ff2
No related branches found
No related tags found
No related merge requests found
...@@ -53,9 +53,13 @@ if [[ "$SPARK_LAUNCH_WITH_SCALA" != "0" ]] ; then ...@@ -53,9 +53,13 @@ if [[ "$SPARK_LAUNCH_WITH_SCALA" != "0" ]] ; then
export SPARK_LAUNCH_WITH_SCALA=1 export SPARK_LAUNCH_WITH_SCALA=1
fi fi
if [ -n "$IPYTHON_OPTS" ]; then
IPYTHON=1
fi
if [[ "$IPYTHON" = "1" ]] ; then if [[ "$IPYTHON" = "1" ]] ; then
export PYSPARK_PYTHON="ipython" IPYTHON_OPTS=${IPYTHON_OPTS:--i}
exec "$PYSPARK_PYTHON" -i -c "%run $PYTHONSTARTUP" exec ipython "$IPYTHON_OPTS" -c "%run $PYTHONSTARTUP"
else else
exec "$PYSPARK_PYTHON" "$@" exec "$PYSPARK_PYTHON" "$@"
fi fi
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment