-
- Downloads
"git@gitlab.engr.illinois.edu:cs525-sp18-g07/spark.git" did not exist on "54b4f2ad43c0ad333a3751a7f10da711b94677a0"
[SPARK-9095] [SQL] Removes the old Parquet support
This PR removes the old Parquet support: - Removes the old `ParquetRelation` together with related SQL configuration, plan nodes, strategies, utility classes, and test suites. - Renames `ParquetRelation2` to `ParquetRelation` - Renames `RowReadSupport` and `RowRecordMaterializer` to `CatalystReadSupport` and `CatalystRecordMaterializer` respectively, and moved them to separate files. This follows naming convention used in other Parquet data models implemented in parquet-mr. It should be easier for developers who are familiar with Parquet to follow. There's still some other code that can be cleaned up. Especially `RowWriteSupport`. But I'd like to leave this part to SPARK-8848. Author: Cheng Lian <lian@databricks.com> Closes #7441 from liancheng/spark-9095 and squashes the following commits: c7b6e38 [Cheng Lian] Removes WriteToFile 2d688d6 [Cheng Lian] Renames ParquetRelation2 to ParquetRelation ca9e1b7 [Cheng Lian] Removes old Parquet support
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicOperators.scala 0 additions, 6 deletions...che/spark/sql/catalyst/plans/logical/basicOperators.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala 2 additions, 7 deletionssql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala 4 additions, 4 deletions...src/main/scala/org/apache/spark/sql/DataFrameReader.scala
- sql/core/src/main/scala/org/apache/spark/sql/SQLConf.scala 0 additions, 6 deletionssql/core/src/main/scala/org/apache/spark/sql/SQLConf.scala
- sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala 1 addition, 5 deletions...core/src/main/scala/org/apache/spark/sql/SQLContext.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala 3 additions, 55 deletions...cala/org/apache/spark/sql/execution/SparkStrategies.scala
- sql/core/src/main/scala/org/apache/spark/sql/parquet/CatalystReadSupport.scala 153 additions, 0 deletions...la/org/apache/spark/sql/parquet/CatalystReadSupport.scala
- sql/core/src/main/scala/org/apache/spark/sql/parquet/CatalystRecordMaterializer.scala 41 additions, 0 deletions...apache/spark/sql/parquet/CatalystRecordMaterializer.scala
- sql/core/src/main/scala/org/apache/spark/sql/parquet/CatalystSchemaConverter.scala 5 additions, 0 deletions...rg/apache/spark/sql/parquet/CatalystSchemaConverter.scala
- sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetConverter.scala 1 addition, 0 deletions...scala/org/apache/spark/sql/parquet/ParquetConverter.scala
- sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetRelation.scala 699 additions, 144 deletions.../scala/org/apache/spark/sql/parquet/ParquetRelation.scala
- sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableOperations.scala 0 additions, 492 deletions...org/apache/spark/sql/parquet/ParquetTableOperations.scala
- sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableSupport.scala 2 additions, 149 deletions...la/org/apache/spark/sql/parquet/ParquetTableSupport.scala
- sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTypes.scala 1 addition, 41 deletions...ain/scala/org/apache/spark/sql/parquet/ParquetTypes.scala
- sql/core/src/main/scala/org/apache/spark/sql/parquet/newParquet.scala 0 additions, 732 deletions.../main/scala/org/apache/spark/sql/parquet/newParquet.scala
- sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetFilterSuite.scala 5 additions, 60 deletions...ala/org/apache/spark/sql/parquet/ParquetFilterSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetIOSuite.scala 6 additions, 31 deletions...t/scala/org/apache/spark/sql/parquet/ParquetIOSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetPartitionDiscoverySuite.scala 1 addition, 1 deletion...he/spark/sql/parquet/ParquetPartitionDiscoverySuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetQuerySuite.scala 1 addition, 26 deletions...cala/org/apache/spark/sql/parquet/ParquetQuerySuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetSchemaSuite.scala 6 additions, 6 deletions...ala/org/apache/spark/sql/parquet/ParquetSchemaSuite.scala
Loading
Please register or sign in to comment