-
- Downloads
[SPARK-4485] [SQL] 1) Add broadcast hash outer join, (2) Fix SparkPlanTest
This pull request (1) extracts common functions used by hash outer joins and put it in interface HashOuterJoin (2) adds ShuffledHashOuterJoin and BroadcastHashOuterJoin (3) adds test cases for shuffled and broadcast hash outer join (3) makes SparkPlanTest to support binary or more complex operators, and fixes bugs in plan composition in SparkPlanTest Author: kai <kaizeng@eecs.berkeley.edu> Closes #7162 from kai-zeng/outer and squashes the following commits: 3742359 [kai] Fix not-serializable exception for code-generated keys in broadcasted relations 14e4bf8 [kai] Use CanBroadcast in broadcast outer join planning dc5127e [kai] code style fixes b5a4efa [kai] (1) Add broadcast hash outer join, (2) Fix SparkPlanTest
Showing
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala 11 additions, 1 deletion...cala/org/apache/spark/sql/execution/SparkStrategies.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastHashOuterJoin.scala 121 additions, 0 deletions...he/spark/sql/execution/joins/BroadcastHashOuterJoin.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/joins/HashOuterJoin.scala 22 additions, 73 deletions.../org/apache/spark/sql/execution/joins/HashOuterJoin.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/joins/ShuffledHashOuterJoin.scala 85 additions, 0 deletions...che/spark/sql/execution/joins/ShuffledHashOuterJoin.scala
- sql/core/src/test/scala/org/apache/spark/sql/JoinSuite.scala 35 additions, 5 deletionssql/core/src/test/scala/org/apache/spark/sql/JoinSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/SparkPlanTest.scala 79 additions, 20 deletions.../scala/org/apache/spark/sql/execution/SparkPlanTest.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/joins/OuterJoinSuite.scala 88 additions, 0 deletions...org/apache/spark/sql/execution/joins/OuterJoinSuite.scala
Loading
Please register or sign in to comment