-
- Downloads
[SPARK-17190][SQL] Removal of HiveSharedState
### What changes were proposed in this pull request? Since `HiveClient` is used to interact with the Hive metastore, it should be hidden in `HiveExternalCatalog`. After moving `HiveClient` into `HiveExternalCatalog`, `HiveSharedState` becomes a wrapper of `HiveExternalCatalog`. Thus, removal of `HiveSharedState` becomes straightforward. After removal of `HiveSharedState`, the reflection logic is directly applied on the choice of `ExternalCatalog` types, based on the configuration of `CATALOG_IMPLEMENTATION`. ~~`HiveClient` is also used/invoked by the other entities besides HiveExternalCatalog, we defines the following two APIs: getClient and getNewClient~~ ### How was this patch tested? The existing test cases Author: gatorsmile <gatorsmile@gmail.com> Closes #14757 from gatorsmile/removeHiveClient.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/InMemoryCatalog.scala 6 additions, 2 deletions...g/apache/spark/sql/catalyst/catalog/InMemoryCatalog.scala
- sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala 1 addition, 13 deletions...re/src/main/scala/org/apache/spark/sql/SparkSession.scala
- sql/core/src/main/scala/org/apache/spark/sql/internal/SharedState.scala 45 additions, 2 deletions...ain/scala/org/apache/spark/sql/internal/SharedState.scala
- sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2.scala 1 addition, 1 deletion...pache/spark/sql/hive/thriftserver/HiveThriftServer2.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala 0 additions, 4 deletions...rc/main/scala/org/apache/spark/sql/hive/HiveContext.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala 9 additions, 1 deletion...scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala 2 additions, 1 deletion...cala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveSessionState.scala 3 additions, 6 deletions...in/scala/org/apache/spark/sql/hive/HiveSessionState.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveSharedState.scala 0 additions, 47 deletions...ain/scala/org/apache/spark/sql/hive/HiveSharedState.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala 7 additions, 8 deletions.../main/scala/org/apache/spark/sql/hive/test/TestHive.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveDataFrameSuite.scala 1 addition, 1 deletion.../scala/org/apache/spark/sql/hive/HiveDataFrameSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveExternalCatalogSuite.scala 8 additions, 8 deletions.../org/apache/spark/sql/hive/HiveExternalCatalogSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveSparkSubmitSuite.scala 2 additions, 3 deletions...cala/org/apache/spark/sql/hive/HiveSparkSubmitSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/MetastoreDataSourcesSuite.scala 2 additions, 1 deletion...org/apache/spark/sql/hive/MetastoreDataSourcesSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/ShowCreateTableSuite.scala 1 addition, 1 deletion...cala/org/apache/spark/sql/hive/ShowCreateTableSuite.scala
Loading
Please register or sign in to comment