-
- Downloads
[SPARK-21228][SQL] InSet incorrect handling of structs
## What changes were proposed in this pull request? When data type is struct, InSet now uses TypeUtils.getInterpretedOrdering (similar to EqualTo) to build a TreeSet. In other cases it will use a HashSet as before (which should be faster). Similarly, In.eval uses Ordering.equiv instead of equals. ## How was this patch tested? New test in SQLQuerySuite. Author: Bogdan Raducanu <bogdan@databricks.com> Closes #18455 from bogdanrdc/SPARK-21228.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala 37 additions, 20 deletions...rg/apache/spark/sql/catalyst/expressions/predicates.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/PredicateSuite.scala 18 additions, 13 deletions...pache/spark/sql/catalyst/expressions/PredicateSuite.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/OptimizeInSuite.scala 1 addition, 1 deletion...apache/spark/sql/catalyst/optimizer/OptimizeInSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala 22 additions, 0 deletions...e/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala
Loading
Please register or sign in to comment