-
- Downloads
[SPARK-13330][PYSPARK] PYTHONHASHSEED is not propgated to python worker
## What changes were proposed in this pull request? self.environment will be propagated to executor. Should set PYTHONHASHSEED as long as the python version is greater than 3.3 ## How was this patch tested? Manually tested it. Author: Jeff Zhang <zjffdu@apache.org> Closes #11211 from zjffdu/SPARK-13330.
Showing
- core/src/main/scala/org/apache/spark/deploy/PythonRunner.scala 1 addition, 0 deletions...src/main/scala/org/apache/spark/deploy/PythonRunner.scala
- python/pyspark/context.py 2 additions, 4 deletionspython/pyspark/context.py
- python/pyspark/rdd.py 2 additions, 1 deletionpython/pyspark/rdd.py
- resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala 1 addition, 0 deletions.../src/main/scala/org/apache/spark/deploy/yarn/Client.scala
Loading
Please register or sign in to comment