-
- Downloads
[SPARK-21637][SPARK-21451][SQL] get `spark.hadoop.*` properties from sysProps to hiveconf
## What changes were proposed in this pull request? When we use `bin/spark-sql` command configuring `--conf spark.hadoop.foo=bar`, the `SparkSQLCliDriver` initializes an instance of hiveconf, it does not add `foo->bar` to it. this pr gets `spark.hadoop.*` properties from sysProps to this hiveconf ## How was this patch tested? UT Author: hzyaoqin <hzyaoqin@corp.netease.com> Author: Kent Yao <yaooqinn@hotmail.com> Closes #18668 from yaooqinn/SPARK-21451.
Showing
- core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala 26 additions, 7 deletions.../main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala
- docs/configuration.md 33 additions, 1 deletiondocs/configuration.md
- sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkSQLCLIDriver.scala 13 additions, 6 deletions...pache/spark/sql/hive/thriftserver/SparkSQLCLIDriver.scala
- sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/CliSuite.scala 13 additions, 0 deletions...ala/org/apache/spark/sql/hive/thriftserver/CliSuite.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala 8 additions, 0 deletions.../src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveUtilsSuite.scala 9 additions, 0 deletions...test/scala/org/apache/spark/sql/hive/HiveUtilsSuite.scala
Loading
Please register or sign in to comment