-
- Downloads
[SPARK-14647][SQL] Group SQLContext/HiveContext state into SharedState
## What changes were proposed in this pull request? This patch adds a SharedState that groups state shared across multiple SQLContexts. This is analogous to the SessionState added in SPARK-13526 that groups session-specific state. This cleanup makes the constructors of the contexts simpler and ultimately allows us to remove HiveContext in the near future. ## How was this patch tested? Existing tests. Closes #12405 Author: Andrew Or <andrew@databricks.com> Author: Yin Huai <yhuai@databricks.com> Closes #12447 from yhuai/sharedState.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala 14 additions, 17 deletions...core/src/main/scala/org/apache/spark/sql/SQLContext.scala
- sql/core/src/main/scala/org/apache/spark/sql/internal/SessionState.scala 0 additions, 2 deletions...in/scala/org/apache/spark/sql/internal/SessionState.scala
- sql/core/src/main/scala/org/apache/spark/sql/internal/SharedState.scala 47 additions, 0 deletions...ain/scala/org/apache/spark/sql/internal/SharedState.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala 15 additions, 36 deletions...rc/main/scala/org/apache/spark/sql/hive/HiveContext.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveSessionState.scala 13 additions, 2 deletions...in/scala/org/apache/spark/sql/hive/HiveSessionState.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveSharedState.scala 53 additions, 0 deletions...ain/scala/org/apache/spark/sql/hive/HiveSharedState.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala 29 additions, 57 deletions.../main/scala/org/apache/spark/sql/hive/test/TestHive.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveExternalCatalogSuite.scala 4 additions, 8 deletions.../org/apache/spark/sql/hive/HiveExternalCatalogSuite.scala
Loading
Please register or sign in to comment