-
- Downloads
[SPARK-19152][SQL][FOLLOWUP] simplify CreateHiveTableAsSelectCommand
## What changes were proposed in this pull request? After https://github.com/apache/spark/pull/16552 , `CreateHiveTableAsSelectCommand` becomes very similar to `CreateDataSourceTableAsSelectCommand`, and we can further simplify it by only creating table in the table-not-exist branch. This PR also adds hive provider checking in DataStream reader/writer, which is missed in #16552 ## How was this patch tested? N/A Author: Wenchen Fan <wenchen@databricks.com> Closes #16693 from cloud-fan/minor.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala 6 additions, 0 deletions...ala/org/apache/spark/sql/streaming/DataStreamReader.scala
- sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamWriter.scala 6 additions, 0 deletions...ala/org/apache/spark/sql/streaming/DataStreamWriter.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/CreateHiveTableAsSelectCommand.scala 25 additions, 41 deletions...k/sql/hive/execution/CreateHiveTableAsSelectCommand.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala 12 additions, 1 deletion...la/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala
Loading
Please register or sign in to comment