-
- Downloads
[SPARK-19763][SQL] qualified external datasource table location stored in catalog
## What changes were proposed in this pull request? If we create a external datasource table with a non-qualified location , we should qualified it to store in catalog. ``` CREATE TABLE t(a string) USING parquet LOCATION '/path/xx' CREATE TABLE t1(a string, b string) USING parquet PARTITIONED BY(b) LOCATION '/path/xx' ``` when we get the table from catalog, the location should be qualified, e.g.'file:/path/xxx' ## How was this patch tested? unit test added Author: windpiger <songjun@outlook.com> Closes #17095 from windpiger/tablepathQualified.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala 13 additions, 1 deletion...rg/apache/spark/sql/catalyst/catalog/SessionCatalog.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala 40 additions, 10 deletions...ala/org/apache/spark/sql/execution/command/DDLSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/internal/CatalogSuite.scala 1 addition, 2 deletions...st/scala/org/apache/spark/sql/internal/CatalogSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/sources/PathOptionSuite.scala 5 additions, 4 deletions.../scala/org/apache/spark/sql/sources/PathOptionSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala 0 additions, 5 deletions...c/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveMetastoreCatalogSuite.scala 1 addition, 3 deletions...org/apache/spark/sql/hive/HiveMetastoreCatalogSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/client/VersionsSuite.scala 2 additions, 4 deletions...cala/org/apache/spark/sql/hive/client/VersionsSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala 2 additions, 2 deletions...la/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala
Loading
Please register or sign in to comment