-
- Downloads
[SPARK-12724] SQL generation support for persisted data source tables
This PR implements SQL generation support for persisted data source tables. A new field `metastoreTableIdentifier: Option[TableIdentifier]` is added to `LogicalRelation`. When a `LogicalRelation` representing a persisted data source relation is created, this field holds the database name and table name of the relation. Author: Cheng Lian <lian@databricks.com> Closes #10712 from liancheng/spark-12724-datasources-sql-gen.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala 1 addition, 1 deletionsql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala 8 additions, 8 deletions.../spark/sql/execution/datasources/DataSourceStrategy.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/LogicalRelation.scala 5 additions, 3 deletions...che/spark/sql/execution/datasources/LogicalRelation.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetRelation.scala 2 additions, 8 deletions...k/sql/execution/datasources/parquet/ParquetRelation.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/rules.scala 8 additions, 8 deletions...la/org/apache/spark/sql/execution/datasources/rules.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilterSuite.scala 1 addition, 1 deletion...ql/execution/datasources/parquet/ParquetFilterSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetPartitionDiscoverySuite.scala 1 addition, 1 deletion.../datasources/parquet/ParquetPartitionDiscoverySuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/sources/FilteredScanSuite.scala 1 addition, 1 deletion...cala/org/apache/spark/sql/sources/FilteredScanSuite.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala 4 additions, 2 deletions...cala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/SQLBuilder.scala 5 additions, 9 deletions...src/main/scala/org/apache/spark/sql/hive/SQLBuilder.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/commands.scala 1 addition, 1 deletion.../scala/org/apache/spark/sql/hive/execution/commands.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/LogicalPlanToSQLSuite.scala 10 additions, 0 deletions...ala/org/apache/spark/sql/hive/LogicalPlanToSQLSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/MetastoreDataSourcesSuite.scala 1 addition, 1 deletion...org/apache/spark/sql/hive/MetastoreDataSourcesSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala 1 addition, 1 deletion...a/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/OrcFilterSuite.scala 1 addition, 1 deletion.../scala/org/apache/spark/sql/hive/orc/OrcFilterSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/parquetSuites.scala 4 additions, 4 deletions.../test/scala/org/apache/spark/sql/hive/parquetSuites.scala
- sql/hive/src/test/scala/org/apache/spark/sql/sources/hadoopFsRelationSuites.scala 1 addition, 1 deletion...org/apache/spark/sql/sources/hadoopFsRelationSuites.scala
Loading
Please register or sign in to comment