-
- Downloads
[SPARK-19148][SQL] do not expose the external table concept in Catalog
## What changes were proposed in this pull request? In https://github.com/apache/spark/pull/16296 , we reached a consensus that we should hide the external/managed table concept to users and only expose custom table path. This PR renames `Catalog.createExternalTable` to `createTable`(still keep the old versions for backward compatibility), and only set the table type to EXTERNAL if `path` is specified in options. ## How was this patch tested? new tests in `CatalogSuite` Author: Wenchen Fan <wenchen@databricks.com> Closes #16528 from cloud-fan/create-table.
Showing
- project/MimaExcludes.scala 4 additions, 1 deletionproject/MimaExcludes.scala
- python/pyspark/sql/catalog.py 24 additions, 3 deletionspython/pyspark/sql/catalog.py
- sql/core/src/main/scala/org/apache/spark/sql/catalog/Catalog.scala 109 additions, 20 deletions...src/main/scala/org/apache/spark/sql/catalog/Catalog.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/command/createDataSourceTables.scala 0 additions, 9 deletions.../spark/sql/execution/command/createDataSourceTables.scala
- sql/core/src/main/scala/org/apache/spark/sql/internal/CatalogImpl.scala 25 additions, 53 deletions...ain/scala/org/apache/spark/sql/internal/CatalogImpl.scala
- sql/core/src/test/scala/org/apache/spark/sql/internal/CatalogSuite.scala 49 additions, 17 deletions...st/scala/org/apache/spark/sql/internal/CatalogSuite.scala
Loading
Please register or sign in to comment