-
- Downloads
[SPARK-9876][SQL] Update Parquet to 1.8.1.
## What changes were proposed in this pull request? This includes minimal changes to get Spark using the current release of Parquet, 1.8.1. ## How was this patch tested? This uses the existing Parquet tests. Author: Ryan Blue <blue@apache.org> Closes #13280 from rdblue/SPARK-9876-update-parquet.
Showing
- dev/deps/spark-deps-hadoop-2.2 5 additions, 6 deletionsdev/deps/spark-deps-hadoop-2.2
- dev/deps/spark-deps-hadoop-2.3 5 additions, 6 deletionsdev/deps/spark-deps-hadoop-2.3
- dev/deps/spark-deps-hadoop-2.4 5 additions, 6 deletionsdev/deps/spark-deps-hadoop-2.4
- dev/deps/spark-deps-hadoop-2.6 5 additions, 6 deletionsdev/deps/spark-deps-hadoop-2.6
- dev/deps/spark-deps-hadoop-2.7 5 additions, 6 deletionsdev/deps/spark-deps-hadoop-2.7
- pom.xml 1 addition, 1 deletionpom.xml
- sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/SpecificParquetRecordReaderBase.java 13 additions, 7 deletions.../datasources/parquet/SpecificParquetRecordReaderBase.java
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/CatalystReadSupport.scala 8 additions, 4 deletions...l/execution/datasources/parquet/CatalystReadSupport.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/CatalystSchemaConverter.scala 16 additions, 0 deletions...ecution/datasources/parquet/CatalystSchemaConverter.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilters.scala 14 additions, 69 deletions...rk/sql/execution/datasources/parquet/ParquetFilters.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaSuite.scala 14 additions, 6 deletions...ql/execution/datasources/parquet/ParquetSchemaSuite.scala
Loading
Please register or sign in to comment