-
- Downloads
[SPARK-12798] [SQL] generated BroadcastHashJoin
A row from stream side could match multiple rows on build side, the loop for these matched rows should not be interrupted when emitting a row, so we buffer the output rows in a linked list, check the termination condition on producer loop (for example, Range or Aggregate). Author: Davies Liu <davies@databricks.com> Closes #10989 from davies/gen_join.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/execution/BufferedRowIterator.java 23 additions, 7 deletions...a/org/apache/spark/sql/execution/BufferedRowIterator.java
- sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegen.scala 12 additions, 6 deletions...la/org/apache/spark/sql/execution/WholeStageCodegen.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/TungstenAggregate.scala 3 additions, 1 deletion...che/spark/sql/execution/aggregate/TungstenAggregate.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/basicOperators.scala 2 additions, 0 deletions...scala/org/apache/spark/sql/execution/basicOperators.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastHashJoin.scala 88 additions, 4 deletions.../apache/spark/sql/execution/joins/BroadcastHashJoin.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/BenchmarkWholeStageCodegen.scala 27 additions, 1 deletion...ache/spark/sql/execution/BenchmarkWholeStageCodegen.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala 14 additions, 1 deletion...g/apache/spark/sql/execution/WholeStageCodegenSuite.scala
Loading
Please register or sign in to comment