-
- Downloads
[SPARK-16916][SQL] serde/storage properties should not have limitations
## What changes were proposed in this pull request? `CatalogStorageFormat.properties` can be used in 2 ways: 1. for hive tables, it stores the serde properties. 2. for data source tables, it stores the data source options, e.g. `path`, `skipHiveMetadata`, etc. however, both of them have nothing to do with data source properties, e.g. `spark.sql.sources.provider`, so they should not have limitations about data source properties. ## How was this patch tested? existing tests Author: Wenchen Fan <wenchen@databricks.com> Closes #14506 from cloud-fan/table-prop.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala 0 additions, 3 deletions...in/scala/org/apache/spark/sql/execution/command/ddl.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala 0 additions, 1 deletion...scala/org/apache/spark/sql/execution/command/tables.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala 0 additions, 7 deletions...ala/org/apache/spark/sql/execution/command/DDLSuite.scala
Loading
Please register or sign in to comment