-
- Downloads
[SPARK-18885][SQL] unify CREATE TABLE syntax for data source and hive serde tables
## What changes were proposed in this pull request? Today we have different syntax to create data source or hive serde tables, we should unify them to not confuse users and step forward to make hive a data source. Please read https://issues.apache.org/jira/secure/attachment/12843835/CREATE-TABLE.pdf for details. TODO(for follow-up PRs): 1. TBLPROPERTIES is not added to the new syntax, we should decide if we wanna add it later. 2. `SHOW CREATE TABLE` should be updated to use the new syntax. 3. we should decide if we wanna change the behavior of `SET LOCATION`. ## How was this patch tested? new tests Author: Wenchen Fan <wenchen@databricks.com> Closes #16296 from cloud-fan/create-table.
Showing
- docs/sql-programming-guide.md 52 additions, 8 deletionsdocs/sql-programming-guide.md
- examples/src/main/java/org/apache/spark/examples/sql/hive/JavaSparkHiveExample.java 1 addition, 1 deletion.../apache/spark/examples/sql/hive/JavaSparkHiveExample.java
- examples/src/main/python/sql/hive.py 1 addition, 1 deletionexamples/src/main/python/sql/hive.py
- examples/src/main/r/RSparkSQLExample.R 1 addition, 1 deletionexamples/src/main/r/RSparkSQLExample.R
- examples/src/main/scala/org/apache/spark/examples/sql/hive/SparkHiveExample.scala 1 addition, 1 deletion...org/apache/spark/examples/sql/hive/SparkHiveExample.scala
- sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 6 additions, 4 deletions...in/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/CaseInsensitiveMap.scala 2 additions, 0 deletions...g/apache/spark/sql/catalyst/util/CaseInsensitiveMap.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala 25 additions, 32 deletions...scala/org/apache/spark/sql/execution/SparkSqlParser.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala 2 additions, 4 deletions...cala/org/apache/spark/sql/execution/SparkStrategies.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala 5 additions, 1 deletion...in/scala/org/apache/spark/sql/execution/command/ddl.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/rules.scala 3 additions, 4 deletions...la/org/apache/spark/sql/execution/datasources/rules.scala
- sql/core/src/main/scala/org/apache/spark/sql/internal/HiveSerDe.scala 49 additions, 35 deletions.../main/scala/org/apache/spark/sql/internal/HiveSerDe.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/SparkSqlParserSuite.scala 2 additions, 1 deletion.../org/apache/spark/sql/execution/SparkSqlParserSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLCommandSuite.scala 67 additions, 12 deletions.../apache/spark/sql/execution/command/DDLCommandSuite.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala 2 additions, 2 deletions...scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveSessionState.scala 1 addition, 0 deletions...in/scala/org/apache/spark/sql/hive/HiveSessionState.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala 62 additions, 11 deletions...main/scala/org/apache/spark/sql/hive/HiveStrategies.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveOptions.scala 102 additions, 0 deletions...ala/org/apache/spark/sql/hive/execution/HiveOptions.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFileOperator.scala 1 addition, 1 deletion...scala/org/apache/spark/sql/hive/orc/OrcFileOperator.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveDDLCommandSuite.scala 101 additions, 6 deletions...scala/org/apache/spark/sql/hive/HiveDDLCommandSuite.scala
Loading
Please register or sign in to comment