-
- Downloads
[SPARK-7961][SQL]Refactor SQLConf to display better error message
1. Add `SQLConfEntry` to store the information about a configuration. For those configurations that cannot be found in `sql-programming-guide.md`, I left the doc as `<TODO>`. 2. Verify the value when setting a configuration if this is in SQLConf. 3. Use `SET -v` to display all public configurations. Author: zsxwing <zsxwing@gmail.com> Closes #6747 from zsxwing/sqlconf and squashes the following commits: 7d09bad [zsxwing] Use SQLConfEntry in HiveContext 49f6213 [zsxwing] Add getConf, setConf to SQLContext and HiveContext e014f53 [zsxwing] Merge branch 'master' into sqlconf 93dad8e [zsxwing] Fix the unit tests cf950c1 [zsxwing] Fix the code style and tests 3c5f03e [zsxwing] Add unsetConf(SQLConfEntry) and fix the code style a2f4add [zsxwing] getConf will return the default value if a config is not set 037b1db [zsxwing] Add schema to SetCommand 0520c3c [zsxwing] Merge branch 'master' into sqlconf 7afb0ec [zsxwing] Fix the configurations about HiveThriftServer 7e728e3 [zsxwing] Add doc for SQLConfEntry and fix 'toString' 5e95b10 [zsxwing] Add enumConf c6ba76d [zsxwing] setRawString => setConfString, getRawString => getConfString 4abd807 [zsxwing] Fix the test for 'set -v' 6e47e56 [zsxwing] Fix the compilation error 8973ced [zsxwing] Remove floatConf 1fc3a8b [zsxwing] Remove the 'conf' command and use 'set -v' instead 99c9c16 [zsxwing] Fix tests that use SQLConfEntry as a string 88a03cc [zsxwing] Add new lines between confs and return types ce7c6c8 [zsxwing] Remove seqConf f3c1b33 [zsxwing] Refactor SQLConf to display better error message
Showing
- docs/sql-programming-guide.md 2 additions, 2 deletionsdocs/sql-programming-guide.md
- sql/core/src/main/scala/org/apache/spark/sql/SQLConf.scala 398 additions, 95 deletionssql/core/src/main/scala/org/apache/spark/sql/SQLConf.scala
- sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala 22 additions, 3 deletions...core/src/main/scala/org/apache/spark/sql/SQLContext.scala
- sql/core/src/main/scala/org/apache/spark/sql/SparkSQLParser.scala 2 additions, 2 deletions.../src/main/scala/org/apache/spark/sql/SparkSQLParser.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/commands.scala 72 additions, 26 deletions.../main/scala/org/apache/spark/sql/execution/commands.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/debug/package.scala 1 addition, 1 deletion.../scala/org/apache/spark/sql/execution/debug/package.scala
- sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableOperations.scala 4 additions, 4 deletions...org/apache/spark/sql/parquet/ParquetTableOperations.scala
- sql/core/src/main/scala/org/apache/spark/sql/parquet/newParquet.scala 3 additions, 3 deletions.../main/scala/org/apache/spark/sql/parquet/newParquet.scala
- sql/core/src/main/scala/org/apache/spark/sql/sources/commands.scala 1 addition, 1 deletion...rc/main/scala/org/apache/spark/sql/sources/commands.scala
- sql/core/src/main/scala/org/apache/spark/sql/test/TestSQLContext.scala 1 addition, 1 deletion...main/scala/org/apache/spark/sql/test/TestSQLContext.scala
- sql/core/src/test/scala/org/apache/spark/sql/DataFrameAggregateSuite.scala 2 additions, 2 deletions.../scala/org/apache/spark/sql/DataFrameAggregateSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala 7 additions, 7 deletions.../src/test/scala/org/apache/spark/sql/DataFrameSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/JoinSuite.scala 7 additions, 7 deletionssql/core/src/test/scala/org/apache/spark/sql/JoinSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/SQLConfEntrySuite.scala 150 additions, 0 deletions...c/test/scala/org/apache/spark/sql/SQLConfEntrySuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/SQLConfSuite.scala 9 additions, 1 deletion...re/src/test/scala/org/apache/spark/sql/SQLConfSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala 21 additions, 21 deletions...e/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/columnar/PartitionBatchPruningSuite.scala 4 additions, 4 deletions...pache/spark/sql/columnar/PartitionBatchPruningSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/PlannerSuite.scala 4 additions, 4 deletions...t/scala/org/apache/spark/sql/execution/PlannerSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/json/JsonSuite.scala 2 additions, 2 deletions.../src/test/scala/org/apache/spark/sql/json/JsonSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetFilterSuite.scala 7 additions, 7 deletions...ala/org/apache/spark/sql/parquet/ParquetFilterSuite.scala
Loading
Please register or sign in to comment