-
- Downloads
[SPARK-14856] [SQL] returning batch correctly
## What changes were proposed in this pull request? Currently, the Parquet reader decide whether to return batch based on required schema or full schema, it's not consistent, this PR fix that. ## How was this patch tested? Added regression tests. Author: Davies Liu <davies@databricks.com> Closes #12619 from davies/fix_return_batch.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala 3 additions, 2 deletions...in/scala/org/apache/spark/sql/execution/ExistingRDD.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetRelation.scala 7 additions, 8 deletions...k/sql/execution/datasources/parquet/ParquetRelation.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetQuerySuite.scala 25 additions, 0 deletions...sql/execution/datasources/parquet/ParquetQuerySuite.scala
Loading
Please register or sign in to comment