-
- Downloads
[SPARK-15618][SQL][MLLIB] Use SparkSession.builder.sparkContext if applicable.
## What changes were proposed in this pull request? This PR changes function `SparkSession.builder.sparkContext(..)` from **private[sql]** into **private[spark]**, and uses it if applicable like the followings. ``` - val spark = SparkSession.builder().config(sc.getConf).getOrCreate() + val spark = SparkSession.builder().sparkContext(sc).getOrCreate() ``` ## How was this patch tested? Pass the existing Jenkins tests. Author: Dongjoon Hyun <dongjoon@apache.org> Closes #13365 from dongjoon-hyun/SPARK-15618.
Showing
- examples/src/main/scala/org/apache/spark/examples/BroadcastTest.scala 2 additions, 5 deletions.../main/scala/org/apache/spark/examples/BroadcastTest.scala
- examples/src/main/scala/org/apache/spark/examples/mllib/LDAExample.scala 1 addition, 0 deletions...in/scala/org/apache/spark/examples/mllib/LDAExample.scala
- examples/src/main/scala/org/apache/spark/examples/sql/hive/HiveFromSpark.scala 1 addition, 4 deletions...la/org/apache/spark/examples/sql/hive/HiveFromSpark.scala
- mllib/src/main/scala/org/apache/spark/mllib/api/python/PythonMLLibAPI.scala 3 additions, 3 deletions...la/org/apache/spark/mllib/api/python/PythonMLLibAPI.scala
- mllib/src/main/scala/org/apache/spark/mllib/classification/LogisticRegression.scala 1 addition, 1 deletion...pache/spark/mllib/classification/LogisticRegression.scala
- mllib/src/main/scala/org/apache/spark/mllib/classification/NaiveBayes.scala 4 additions, 4 deletions...la/org/apache/spark/mllib/classification/NaiveBayes.scala
- mllib/src/main/scala/org/apache/spark/mllib/classification/impl/GLMClassificationModel.scala 2 additions, 2 deletions...rk/mllib/classification/impl/GLMClassificationModel.scala
- mllib/src/main/scala/org/apache/spark/mllib/clustering/BisectingKMeansModel.scala 2 additions, 2 deletions.../apache/spark/mllib/clustering/BisectingKMeansModel.scala
- mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixtureModel.scala 2 additions, 2 deletions.../apache/spark/mllib/clustering/GaussianMixtureModel.scala
- mllib/src/main/scala/org/apache/spark/mllib/clustering/KMeansModel.scala 2 additions, 2 deletions...scala/org/apache/spark/mllib/clustering/KMeansModel.scala
- mllib/src/main/scala/org/apache/spark/mllib/clustering/LDAModel.scala 4 additions, 4 deletions...in/scala/org/apache/spark/mllib/clustering/LDAModel.scala
- mllib/src/main/scala/org/apache/spark/mllib/clustering/PowerIterationClustering.scala 2 additions, 2 deletions...che/spark/mllib/clustering/PowerIterationClustering.scala
- mllib/src/main/scala/org/apache/spark/mllib/feature/ChiSqSelector.scala 2 additions, 2 deletions.../scala/org/apache/spark/mllib/feature/ChiSqSelector.scala
- mllib/src/main/scala/org/apache/spark/mllib/feature/Word2Vec.scala 2 additions, 2 deletions.../main/scala/org/apache/spark/mllib/feature/Word2Vec.scala
- mllib/src/main/scala/org/apache/spark/mllib/fpm/FPGrowth.scala 2 additions, 2 deletions.../src/main/scala/org/apache/spark/mllib/fpm/FPGrowth.scala
- mllib/src/main/scala/org/apache/spark/mllib/fpm/PrefixSpan.scala 2 additions, 2 deletions...rc/main/scala/org/apache/spark/mllib/fpm/PrefixSpan.scala
- mllib/src/main/scala/org/apache/spark/mllib/recommendation/MatrixFactorizationModel.scala 2 additions, 2 deletions...spark/mllib/recommendation/MatrixFactorizationModel.scala
- mllib/src/main/scala/org/apache/spark/mllib/regression/IsotonicRegression.scala 2 additions, 2 deletions...rg/apache/spark/mllib/regression/IsotonicRegression.scala
- mllib/src/main/scala/org/apache/spark/mllib/regression/impl/GLMRegressionModel.scala 2 additions, 2 deletions...ache/spark/mllib/regression/impl/GLMRegressionModel.scala
- mllib/src/main/scala/org/apache/spark/mllib/tree/model/DecisionTreeModel.scala 2 additions, 2 deletions...org/apache/spark/mllib/tree/model/DecisionTreeModel.scala
Loading
Please register or sign in to comment