-
- Downloads
[SPARK-21052][SQL] Add hash map metrics to join
## What changes were proposed in this pull request? This adds the average hash map probe metrics to join operator such as `BroadcastHashJoin` and `ShuffledHashJoin`. This PR adds the API to `HashedRelation` to get average hash map probe. ## How was this patch tested? Related test cases are added. Author: Liang-Chi Hsieh <viirya@gmail.com> Closes #18301 from viirya/SPARK-21052.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/HashAggregateExec.scala 7 additions, 8 deletions...che/spark/sql/execution/aggregate/HashAggregateExec.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/TungstenAggregationIterator.scala 17 additions, 17 deletions...sql/execution/aggregate/TungstenAggregationIterator.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastHashJoinExec.scala 28 additions, 2 deletions...che/spark/sql/execution/joins/BroadcastHashJoinExec.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/joins/HashJoin.scala 7 additions, 1 deletion...scala/org/apache/spark/sql/execution/joins/HashJoin.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/joins/HashedRelation.scala 40 additions, 3 deletions...org/apache/spark/sql/execution/joins/HashedRelation.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/joins/ShuffledHashJoinExec.scala 4 additions, 2 deletions...ache/spark/sql/execution/joins/ShuffledHashJoinExec.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/metric/SQLMetrics.scala 25 additions, 7 deletions...la/org/apache/spark/sql/execution/metric/SQLMetrics.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/metric/SQLMetricsSuite.scala 168 additions, 20 deletions...g/apache/spark/sql/execution/metric/SQLMetricsSuite.scala
Loading
Please register or sign in to comment