-
- Downloads
[SPARK-15019][SQL] Propagate all Spark Confs to HiveConf created in HiveClientImpl
## What changes were proposed in this pull request? This PR makes two changes: 1. We will propagate Spark Confs to HiveConf created in HiveClientImpl. So, users can also use spark conf to set warehouse location and metastore url. 2. In sql/hive, HiveClientImpl will be the only place where we create a new HiveConf. ## How was this patch tested? Existing tests. Author: Yin Huai <yhuai@databricks.com> Closes #12791 from yhuai/onlyUseHiveConfInHiveClientImpl.
Showing
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala 7 additions, 15 deletions.../src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/TableReader.scala 2 additions, 2 deletions...rc/main/scala/org/apache/spark/sql/hive/TableReader.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala 35 additions, 14 deletions...ala/org/apache/spark/sql/hive/client/HiveClientImpl.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveTableScanExec.scala 1 addition, 1 deletion...g/apache/spark/sql/hive/execution/HiveTableScanExec.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala 3 additions, 5 deletions.../main/scala/org/apache/spark/sql/hive/test/TestHive.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/InsertIntoHiveTableSuite.scala 2 additions, 1 deletion.../org/apache/spark/sql/hive/InsertIntoHiveTableSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/ParquetHiveCompatibilitySuite.scala 2 additions, 2 deletions...apache/spark/sql/hive/ParquetHiveCompatibilitySuite.scala
Loading
Please register or sign in to comment