-
- Downloads
[SPARK-17075][SQL][FOLLOWUP] fix filter estimation issues
## What changes were proposed in this pull request? 1. support boolean type in binary expression estimation. 2. deal with compound Not conditions. 3. avoid convert BigInt/BigDecimal directly to double unless it's within range (0, 1). 4. reorganize test code. ## How was this patch tested? modify related test cases. Author: wangzhenhua <wangzhenhua@huawei.com> Author: Zhenhua Wang <wzh_zju@163.com> Closes #17148 from wzhfy/fixFilter.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statsEstimation/FilterEstimation.scala 98 additions, 76 deletions...lyst/plans/logical/statsEstimation/FilterEstimation.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/statsEstimation/FilterEstimationSuite.scala 199 additions, 198 deletions.../sql/catalyst/statsEstimation/FilterEstimationSuite.scala
Loading
Please register or sign in to comment