-
- Downloads
[SPARK-14861][SQL] Replace internal usages of SQLContext with SparkSession
## What changes were proposed in this pull request? In Spark 2.0, `SparkSession` is the new thing. Internally we should stop using `SQLContext` everywhere since that's supposed to be not the main user-facing API anymore. In this patch I took care to not break any public APIs. The one place that's suspect is `o.a.s.ml.source.libsvm.DefaultSource`, but according to mengxr it's not supposed to be public so it's OK to change the underlying `FileFormat` trait. **Reviewers**: This is a big patch that may be difficult to review but the changes are actually really straightforward. If you prefer I can break it up into a few smaller patches, but it will delay the progress of this issue a little. ## How was this patch tested? No change in functionality intended. Author: Andrew Or <andrew@databricks.com> Closes #12625 from andrewor14/spark-session-refactor.
Showing
- mllib/src/main/scala/org/apache/spark/ml/classification/GBTClassifier.scala 1 addition, 1 deletion...la/org/apache/spark/ml/classification/GBTClassifier.scala
- mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala 2 additions, 2 deletions...g/apache/spark/ml/classification/LogisticRegression.scala
- mllib/src/main/scala/org/apache/spark/ml/classification/RandomForestClassifier.scala 1 addition, 1 deletion...ache/spark/ml/classification/RandomForestClassifier.scala
- mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala 23 additions, 23 deletions...b/src/main/scala/org/apache/spark/ml/clustering/LDA.scala
- mllib/src/main/scala/org/apache/spark/ml/feature/CountVectorizer.scala 1 addition, 1 deletion...n/scala/org/apache/spark/ml/feature/CountVectorizer.scala
- mllib/src/main/scala/org/apache/spark/ml/feature/SQLTransformer.scala 1 addition, 1 deletion...in/scala/org/apache/spark/ml/feature/SQLTransformer.scala
- mllib/src/main/scala/org/apache/spark/ml/feature/Word2Vec.scala 1 addition, 1 deletion...src/main/scala/org/apache/spark/ml/feature/Word2Vec.scala
- mllib/src/main/scala/org/apache/spark/ml/recommendation/ALS.scala 1 addition, 1 deletion...c/main/scala/org/apache/spark/ml/recommendation/ALS.scala
- mllib/src/main/scala/org/apache/spark/ml/regression/GBTRegressor.scala 1 addition, 1 deletion...n/scala/org/apache/spark/ml/regression/GBTRegressor.scala
- mllib/src/main/scala/org/apache/spark/ml/regression/RandomForestRegressor.scala 1 addition, 1 deletion...rg/apache/spark/ml/regression/RandomForestRegressor.scala
- mllib/src/main/scala/org/apache/spark/ml/source/libsvm/LibSVMRelation.scala 11 additions, 11 deletions...la/org/apache/spark/ml/source/libsvm/LibSVMRelation.scala
- mllib/src/main/scala/org/apache/spark/ml/tuning/CrossValidator.scala 3 additions, 3 deletions...ain/scala/org/apache/spark/ml/tuning/CrossValidator.scala
- mllib/src/main/scala/org/apache/spark/ml/tuning/TrainValidationSplit.scala 0 additions, 1 deletion...ala/org/apache/spark/ml/tuning/TrainValidationSplit.scala
- mllib/src/main/scala/org/apache/spark/ml/util/ReadWrite.scala 5 additions, 3 deletions...b/src/main/scala/org/apache/spark/ml/util/ReadWrite.scala
- project/MimaExcludes.scala 14 additions, 0 deletionsproject/MimaExcludes.scala
- sql/core/src/main/scala/org/apache/spark/sql/ContinuousQuery.scala 2 additions, 2 deletions...src/main/scala/org/apache/spark/sql/ContinuousQuery.scala
- sql/core/src/main/scala/org/apache/spark/sql/ContinuousQueryManager.scala 6 additions, 6 deletions...n/scala/org/apache/spark/sql/ContinuousQueryManager.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrameNaFunctions.scala 4 additions, 4 deletions...ain/scala/org/apache/spark/sql/DataFrameNaFunctions.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala 19 additions, 19 deletions...src/main/scala/org/apache/spark/sql/DataFrameReader.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala 15 additions, 15 deletions...src/main/scala/org/apache/spark/sql/DataFrameWriter.scala
Loading
Please register or sign in to comment