-
- Downloads
[SPARK-13917] [SQL] generate broadcast semi join
## What changes were proposed in this pull request? This PR brings codegen support for broadcast left-semi join. ## How was this patch tested? Existing tests. Added benchmark, the result show 7X speedup. Author: Davies Liu <davies@databricks.com> Closes #11742 from davies/gen_semi.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala 2 additions, 2 deletions...cala/org/apache/spark/sql/execution/SparkStrategies.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastHashJoin.scala 75 additions, 6 deletions.../apache/spark/sql/execution/joins/BroadcastHashJoin.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastLeftSemiJoinHash.scala 0 additions, 57 deletions...spark/sql/execution/joins/BroadcastLeftSemiJoinHash.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/joins/HashJoin.scala 20 additions, 3 deletions...scala/org/apache/spark/sql/execution/joins/HashJoin.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/joins/HashSemiJoin.scala 0 additions, 61 deletions...a/org/apache/spark/sql/execution/joins/HashSemiJoin.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/joins/LeftSemiJoinHash.scala 6 additions, 2 deletions...g/apache/spark/sql/execution/joins/LeftSemiJoinHash.scala
- sql/core/src/test/scala/org/apache/spark/sql/JoinSuite.scala 2 additions, 2 deletionssql/core/src/test/scala/org/apache/spark/sql/JoinSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/BenchmarkWholeStageCodegen.scala 13 additions, 1 deletion...ache/spark/sql/execution/BenchmarkWholeStageCodegen.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/joins/BroadcastJoinSuite.scala 1 addition, 1 deletion...apache/spark/sql/execution/joins/BroadcastJoinSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/joins/SemiJoinSuite.scala 3 additions, 2 deletions.../org/apache/spark/sql/execution/joins/SemiJoinSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala 2 additions, 2 deletions...est/scala/org/apache/spark/sql/hive/StatisticsSuite.scala
Loading
Please register or sign in to comment