-
- Downloads
[SPARK-4468][SQL] Fixes Parquet filter creation for inequality predicates with...
[SPARK-4468][SQL] Fixes Parquet filter creation for inequality predicates with literals on the left hand side For expressions like `10 < someVar`, we should create an `Operators.Gt` filter, but right now an `Operators.Lt` is created. This issue affects all inequality predicates with literals on the left hand side. (This bug existed before #3317 and affects branch-1.1. #3338 was opened to backport this to branch-1.1.) <!-- Reviewable:start --> [<img src="https://reviewable.io/review_button.png" height=40 alt="Review on Reviewable"/>](https://reviewable.io/reviews/apache/spark/3334) <!-- Reviewable:end --> Author: Cheng Lian <lian@databricks.com> Closes #3334 from liancheng/fix-parquet-comp-filter and squashes the following commits: 0130897 [Cheng Lian] Fixes Parquet comparison filter generation
Showing
- sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetFilters.scala 4 additions, 4 deletions...n/scala/org/apache/spark/sql/parquet/ParquetFilters.scala
- sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetQuerySuite.scala 12 additions, 0 deletions...cala/org/apache/spark/sql/parquet/ParquetQuerySuite.scala
Please register or sign in to comment