-
- Downloads
[SPARK-14853] [SQL] Support LeftSemi/LeftAnti in SortMergeJoinExec
## What changes were proposed in this pull request? This PR update SortMergeJoinExec to support LeftSemi/LeftAnti, so it could support all the join types, same as other three join implementations: BroadcastHashJoinExec, ShuffledHashJoinExec,and BroadcastNestedLoopJoinExec. This PR also simplify the join selection in SparkStrategy. ## How was this patch tested? Added new tests. Author: Davies Liu <davies@databricks.com> Closes #12668 from davies/smj_semi.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlanner.scala 2 additions, 6 deletions...n/scala/org/apache/spark/sql/execution/SparkPlanner.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala 71 additions, 121 deletions...cala/org/apache/spark/sql/execution/SparkStrategies.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/joins/CartesianProductExec.scala 17 additions, 3 deletions...ache/spark/sql/execution/joins/CartesianProductExec.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala 78 additions, 13 deletions.../apache/spark/sql/execution/joins/SortMergeJoinExec.scala
- sql/core/src/test/scala/org/apache/spark/sql/JoinSuite.scala 7 additions, 7 deletionssql/core/src/test/scala/org/apache/spark/sql/JoinSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/joins/ExistenceJoinSuite.scala 12 additions, 0 deletions...apache/spark/sql/execution/joins/ExistenceJoinSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/joins/InnerJoinSuite.scala 1 addition, 1 deletion...org/apache/spark/sql/execution/joins/InnerJoinSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/metric/SQLMetricsSuite.scala 2 additions, 16 deletions...g/apache/spark/sql/execution/metric/SQLMetricsSuite.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveSessionState.scala 2 additions, 6 deletions...in/scala/org/apache/spark/sql/hive/HiveSessionState.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala 2 additions, 2 deletions...est/scala/org/apache/spark/sql/hive/StatisticsSuite.scala
Loading
Please register or sign in to comment