-
- Downloads
[SPARK-7943] [SPARK-8105] [SPARK-8435] [SPARK-8714] [SPARK-8561] Fixes multi-database support
This PR fixes a set of issues related to multi-database. A new data structure `TableIdentifier` is introduced to identify a table among multiple databases. We should stop using a single `String` (table name without database name), or `Seq[String]` (optional database name plus table name) to identify tables internally. Author: Cheng Lian <lian@databricks.com> Closes #7623 from liancheng/spark-8131-multi-db and squashes the following commits: f3bcd4b [Cheng Lian] Addresses PR comments e0eb76a [Cheng Lian] Fixes styling issues 41e2207 [Cheng Lian] Fixes multi-database support d4d1ec2 [Cheng Lian] Adds multi-database test cases
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala 14 additions, 0 deletions.../main/scala/org/apache/spark/sql/catalyst/SqlParser.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/TableIdentifier.scala 31 additions, 0 deletions...scala/org/apache/spark/sql/catalyst/TableIdentifier.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Catalog.scala 4 additions, 5 deletions...cala/org/apache/spark/sql/catalyst/analysis/Catalog.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala 45 additions, 38 deletions...src/main/scala/org/apache/spark/sql/DataFrameWriter.scala
- sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala 4 additions, 2 deletions...core/src/main/scala/org/apache/spark/sql/SQLContext.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ddl.scala 8 additions, 7 deletions...cala/org/apache/spark/sql/execution/datasources/ddl.scala
- sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetTest.scala 2 additions, 2 deletions...test/scala/org/apache/spark/sql/parquet/ParquetTest.scala
- sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala 28 additions, 1 deletion...c/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala 3 additions, 2 deletions...rc/main/scala/org/apache/spark/sql/hive/HiveContext.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala 25 additions, 6 deletions...cala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/MultiDatabaseSuite.scala 159 additions, 0 deletions.../scala/org/apache/spark/sql/hive/MultiDatabaseSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/OrcTest.scala 4 additions, 3 deletions...rc/test/scala/org/apache/spark/sql/hive/orc/OrcTest.scala
Loading
Please register or sign in to comment