-
- Downloads
[SPARK-9858][SQL] Add an ExchangeCoordinator to estimate the number of...
[SPARK-9858][SQL] Add an ExchangeCoordinator to estimate the number of post-shuffle partitions for aggregates and joins (follow-up) https://issues.apache.org/jira/browse/SPARK-9858 This PR is the follow-up work of https://github.com/apache/spark/pull/9276. It addresses JoshRosen's comments. Author: Yin Huai <yhuai@databricks.com> Closes #9453 from yhuai/numReducer-followUp.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/physical/partitioning.scala 0 additions, 8 deletions...ache/spark/sql/catalyst/plans/physical/partitioning.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/Exchange.scala 30 additions, 10 deletions.../main/scala/org/apache/spark/sql/execution/Exchange.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/ExchangeCoordinator.scala 21 additions, 10 deletions.../org/apache/spark/sql/execution/ExchangeCoordinator.scala
- sql/core/src/test/scala/org/apache/spark/sql/CachedTableSuite.scala 116 additions, 34 deletions...rc/test/scala/org/apache/spark/sql/CachedTableSuite.scala
Loading
Please register or sign in to comment