-
- Downloads
[SPARK-21278][PYSPARK] Upgrade to Py4J 0.10.6
## What changes were proposed in this pull request? This PR aims to bump Py4J in order to fix the following float/double bug. Py4J 0.10.5 fixes this (https://github.com/bartdag/py4j/issues/272) and the latest Py4J is 0.10.6. **BEFORE** ``` >>> df = spark.range(1) >>> df.select(df['id'] + 17.133574204226083).show() +--------------------+ |(id + 17.1335742042)| +--------------------+ | 17.1335742042| +--------------------+ ``` **AFTER** ``` >>> df = spark.range(1) >>> df.select(df['id'] + 17.133574204226083).show() +-------------------------+ |(id + 17.133574204226083)| +-------------------------+ | 17.133574204226083| +-------------------------+ ``` ## How was this patch tested? Manual. Author: Dongjoon Hyun <dongjoon@apache.org> Closes #18546 from dongjoon-hyun/SPARK-21278.
Showing
- LICENSE 1 addition, 1 deletionLICENSE
- bin/pyspark 1 addition, 1 deletionbin/pyspark
- bin/pyspark2.cmd 1 addition, 1 deletionbin/pyspark2.cmd
- core/pom.xml 1 addition, 1 deletioncore/pom.xml
- core/src/main/scala/org/apache/spark/api/python/PythonUtils.scala 1 addition, 1 deletion.../main/scala/org/apache/spark/api/python/PythonUtils.scala
- dev/deps/spark-deps-hadoop-2.6 1 addition, 1 deletiondev/deps/spark-deps-hadoop-2.6
- dev/deps/spark-deps-hadoop-2.7 1 addition, 1 deletiondev/deps/spark-deps-hadoop-2.7
- python/README.md 1 addition, 1 deletionpython/README.md
- python/docs/Makefile 1 addition, 1 deletionpython/docs/Makefile
- python/lib/py4j-0.10.4-src.zip 0 additions, 0 deletionspython/lib/py4j-0.10.4-src.zip
- python/lib/py4j-0.10.6-src.zip 0 additions, 0 deletionspython/lib/py4j-0.10.6-src.zip
- python/setup.py 1 addition, 1 deletionpython/setup.py
- resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala 1 addition, 1 deletion.../src/main/scala/org/apache/spark/deploy/yarn/Client.scala
- resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnClusterSuite.scala 1 addition, 1 deletion...scala/org/apache/spark/deploy/yarn/YarnClusterSuite.scala
- sbin/spark-config.sh 1 addition, 1 deletionsbin/spark-config.sh
Loading
Please register or sign in to comment