-
- Downloads
[SPARK-3343] [SQL] Add serde support for CTAS
Currently, `CTAS` (Create Table As Select) doesn't support specifying the `SerDe` in HQL. This PR will pass down the `ASTNode` into the physical operator `execution.CreateTableAsSelect`, which will extract the `CreateTableDesc` object via Hive `SemanticAnalyzer`. In the meantime, I also update the `HiveMetastoreCatalog.createTable` to optionally support the `CreateTableDesc` for table creation. Author: Cheng Hao <hao.cheng@intel.com> Closes #2570 from chenghao-intel/ctas_serde and squashes the following commits: e011ef5 [Cheng Hao] shim for both 0.12 & 0.13.1 cfb3662 [Cheng Hao] revert to hive 0.12 c8a547d [Cheng Hao] Support SerDe properties within CTAS
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicOperators.scala 5 additions, 3 deletions...che/spark/sql/catalyst/plans/logical/basicOperators.scala
- sql/core/src/main/scala/org/apache/spark/sql/SchemaRDDLike.scala 2 additions, 2 deletions...e/src/main/scala/org/apache/spark/sql/SchemaRDDLike.scala
- sql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala 19 additions, 0 deletionssql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala
- sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala 5 additions, 1 deletion...che/spark/sql/hive/execution/HiveCompatibilitySuite.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala 167 additions, 30 deletions...cala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveQl.scala 5 additions, 10 deletions...ive/src/main/scala/org/apache/spark/sql/hive/HiveQl.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala 8 additions, 9 deletions...main/scala/org/apache/spark/sql/hive/HiveStrategies.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/CreateTableAsSelect.scala 27 additions, 12 deletions...apache/spark/sql/hive/execution/CreateTableAsSelect.scala
- sql/hive/src/test/scala/org/apache/spark/sql/QueryTest.scala 19 additions, 0 deletionssql/hive/src/test/scala/org/apache/spark/sql/QueryTest.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveExplainSuite.scala 12 additions, 25 deletions...rg/apache/spark/sql/hive/execution/HiveExplainSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala 59 additions, 0 deletions...a/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala
- sql/hive/v0.12.0/src/main/scala/org/apache/spark/sql/hive/Shim12.scala 4 additions, 1 deletion...2.0/src/main/scala/org/apache/spark/sql/hive/Shim12.scala
- sql/hive/v0.13.1/src/main/scala/org/apache/spark/sql/hive/Shim13.scala 5 additions, 1 deletion...3.1/src/main/scala/org/apache/spark/sql/hive/Shim13.scala
Loading
Please register or sign in to comment