-
- Downloads
[SPARK-15345][SQL][PYSPARK] SparkSession's conf doesn't take effect when this...
[SPARK-15345][SQL][PYSPARK] SparkSession's conf doesn't take effect when this already an existing SparkContext ## What changes were proposed in this pull request? Override the existing SparkContext is the provided SparkConf is different. PySpark part hasn't been fixed yet, will do that after the first round of review to ensure this is the correct approach. ## How was this patch tested? Manually verify it in spark-shell. rxin Please help review it, I think this is a very critical issue for spark 2.0 Author: Jeff Zhang <zjffdu@apache.org> Closes #13160 from zjffdu/SPARK-15345.
Showing
- core/src/main/scala/org/apache/spark/SparkContext.scala 3 additions, 0 deletionscore/src/main/scala/org/apache/spark/SparkContext.scala
- sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala 12 additions, 2 deletions...re/src/main/scala/org/apache/spark/sql/SparkSession.scala
- sql/core/src/test/scala/org/apache/spark/sql/SparkSessionBuilderSuite.scala 13 additions, 1 deletion...scala/org/apache/spark/sql/SparkSessionBuilderSuite.scala
Loading
Please register or sign in to comment