-
- Downloads
[SPARK-13890][SQL] Remove some internal classes' dependency on SQLContext
## What changes were proposed in this pull request? In general it is better for internal classes to not depend on the external class (in this case SQLContext) to reduce coupling between user-facing APIs and the internal implementations. This patch removes SQLContext dependency from some internal classes such as SparkPlanner, SparkOptimizer. As part of this patch, I also removed the following internal methods from SQLContext: ``` protected[sql] def functionRegistry: FunctionRegistry protected[sql] def optimizer: Optimizer protected[sql] def sqlParser: ParserInterface protected[sql] def planner: SparkPlanner protected[sql] def continuousQueryManager protected[sql] def prepareForExecution: RuleExecutor[SparkPlan] ``` ## How was this patch tested? Existing unit/integration tests. Author: Reynold Xin <rxin@databricks.com> Closes #11712 from rxin/sqlContext-planner.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala 2 additions, 1 deletion...src/main/scala/org/apache/spark/sql/DataFrameReader.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala 3 additions, 3 deletions...src/main/scala/org/apache/spark/sql/DataFrameWriter.scala
- sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala 3 additions, 3 deletionssql/core/src/main/scala/org/apache/spark/sql/Dataset.scala
- sql/core/src/main/scala/org/apache/spark/sql/ExperimentalMethods.scala 1 addition, 1 deletion...main/scala/org/apache/spark/sql/ExperimentalMethods.scala
- sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala 7 additions, 16 deletions...core/src/main/scala/org/apache/spark/sql/SQLContext.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/QueryExecution.scala 3 additions, 3 deletions...scala/org/apache/spark/sql/execution/QueryExecution.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkOptimizer.scala 5 additions, 6 deletions...scala/org/apache/spark/sql/execution/SparkOptimizer.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlanner.scala 8 additions, 4 deletions...n/scala/org/apache/spark/sql/execution/SparkPlanner.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala 2 additions, 2 deletions...cala/org/apache/spark/sql/execution/SparkStrategies.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegen.scala 3 additions, 3 deletions...la/org/apache/spark/sql/execution/WholeStageCodegen.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/command/commands.scala 4 additions, 3 deletions...ala/org/apache/spark/sql/execution/command/commands.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/EnsureRequirements.scala 6 additions, 6 deletions...che/spark/sql/execution/exchange/EnsureRequirements.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/Exchange.scala 3 additions, 3 deletions...la/org/apache/spark/sql/execution/exchange/Exchange.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/subquery.scala 4 additions, 4 deletions.../main/scala/org/apache/spark/sql/execution/subquery.scala
- sql/core/src/main/scala/org/apache/spark/sql/functions.scala 1 addition, 1 deletionsql/core/src/main/scala/org/apache/spark/sql/functions.scala
- sql/core/src/main/scala/org/apache/spark/sql/internal/SessionState.scala 9 additions, 7 deletions...in/scala/org/apache/spark/sql/internal/SessionState.scala
- sql/core/src/test/scala/org/apache/spark/sql/JoinSuite.scala 2 additions, 2 deletionssql/core/src/test/scala/org/apache/spark/sql/JoinSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/SQLContextSuite.scala 1 addition, 1 deletion...src/test/scala/org/apache/spark/sql/SQLContextSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala 2 additions, 1 deletion...e/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/PlannerSuite.scala 13 additions, 13 deletions...t/scala/org/apache/spark/sql/execution/PlannerSuite.scala
Loading
Please register or sign in to comment