-
- Downloads
[SPARK-13403][SQL] Pass hadoopConfiguration to HiveConf constructors.
This commit updates the HiveContext so that sc.hadoopConfiguration is used to instantiate its internal instances of HiveConf. I tested this by overriding the S3 FileSystem implementation from spark-defaults.conf as "spark.hadoop.fs.s3.impl" (to avoid [HADOOP-12810](https://issues.apache.org/jira/browse/HADOOP-12810)). Author: Ryan Blue <blue@apache.org> Closes #11273 from rdblue/SPARK-13403-new-hive-conf-from-hadoop-conf.
Showing
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala 5 additions, 1 deletion...rc/main/scala/org/apache/spark/sql/hive/HiveContext.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala 3 additions, 1 deletion...ala/org/apache/spark/sql/hive/client/HiveClientImpl.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/client/IsolatedClientLoader.scala 6 additions, 2 deletions...g/apache/spark/sql/hive/client/IsolatedClientLoader.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveCatalogSuite.scala 3 additions, 1 deletion...st/scala/org/apache/spark/sql/hive/HiveCatalogSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/client/VersionsSuite.scala 17 additions, 0 deletions...cala/org/apache/spark/sql/hive/client/VersionsSuite.scala
Loading
Please register or sign in to comment