-
- Downloads
[SPARK-9763][SQL] Minimize exposure of internal SQL classes.
There are a few changes in this pull request: 1. Moved all data sources to execution.datasources, except the public JDBC APIs. 2. In order to maintain backward compatibility from 1, added a backward compatibility translation map in data source resolution. 3. Moved ui and metric package into execution. 4. Added more documentation on some internal classes. 5. Renamed DataSourceRegister.format -> shortName. 6. Added "override" modifier on shortName. 7. Removed IntSQLMetric. Author: Reynold Xin <rxin@databricks.com> Closes #8056 from rxin/SPARK-9763 and squashes the following commits: 9df4801 [Reynold Xin] Removed hardcoded name in test cases. d9babc6 [Reynold Xin] Shorten. e484419 [Reynold Xin] Removed VisibleForTesting. 171b812 [Reynold Xin] MimaExcludes. 2041389 [Reynold Xin] Compile ... 79dda42 [Reynold Xin] Compile. 0818ba3 [Reynold Xin] Removed IntSQLMetric. c46884f [Reynold Xin] Two more fixes. f9aa88d [Reynold Xin] [SPARK-9763][SQL] Minimize exposure of internal SQL classes.
Showing
- project/MimaExcludes.scala 21 additions, 3 deletionsproject/MimaExcludes.scala
- sql/core/src/main/resources/META-INF/services/org.apache.spark.sql.sources.DataSourceRegister 3 additions, 3 deletions.../services/org.apache.spark.sql.sources.DataSourceRegister
- sql/core/src/main/resources/org/apache/spark/sql/execution/ui/static/spark-sql-viz.css 0 additions, 0 deletions...rg/apache/spark/sql/execution/ui/static/spark-sql-viz.css
- sql/core/src/main/resources/org/apache/spark/sql/execution/ui/static/spark-sql-viz.js 0 additions, 0 deletions...org/apache/spark/sql/execution/ui/static/spark-sql-viz.js
- sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala 1 addition, 1 deletionsql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala 3 additions, 3 deletions...src/main/scala/org/apache/spark/sql/DataFrameReader.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala 3 additions, 3 deletions...src/main/scala/org/apache/spark/sql/DataFrameWriter.scala
- sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala 1 addition, 1 deletion...core/src/main/scala/org/apache/spark/sql/SQLContext.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/SQLExecution.scala 1 addition, 1 deletion...n/scala/org/apache/spark/sql/execution/SQLExecution.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlan.scala 1 addition, 7 deletions...main/scala/org/apache/spark/sql/execution/SparkPlan.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/basicOperators.scala 1 addition, 1 deletion...scala/org/apache/spark/sql/execution/basicOperators.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DDLParser.scala 185 additions, 0 deletions...rg/apache/spark/sql/execution/datasources/DDLParser.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DefaultSource.scala 64 additions, 0 deletions...pache/spark/sql/execution/datasources/DefaultSource.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InsertIntoDataSource.scala 3 additions, 20 deletions...park/sql/execution/datasources/InsertIntoDataSource.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ResolvedDataSource.scala 204 additions, 0 deletions.../spark/sql/execution/datasources/ResolvedDataSource.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ddl.scala 13 additions, 339 deletions...cala/org/apache/spark/sql/execution/datasources/ddl.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/DefaultSource.scala 62 additions, 0 deletions.../spark/sql/execution/datasources/jdbc/DefaultSource.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/DriverRegistry.scala 60 additions, 0 deletions...spark/sql/execution/datasources/jdbc/DriverRegistry.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/DriverWrapper.scala 48 additions, 0 deletions.../spark/sql/execution/datasources/jdbc/DriverWrapper.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala 4 additions, 5 deletions...apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala
Loading
Please register or sign in to comment