-
- Downloads
[SPARK-9858][SPARK-9859][SPARK-9861][SQL] Add an ExchangeCoordinator to...
[SPARK-9858][SPARK-9859][SPARK-9861][SQL] Add an ExchangeCoordinator to estimate the number of post-shuffle partitions for aggregates and joins https://issues.apache.org/jira/browse/SPARK-9858 https://issues.apache.org/jira/browse/SPARK-9859 https://issues.apache.org/jira/browse/SPARK-9861 Author: Yin Huai <yhuai@databricks.com> Closes #9276 from yhuai/numReducer.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/physical/partitioning.scala 8 additions, 0 deletions...ache/spark/sql/catalyst/plans/physical/partitioning.scala
- sql/core/src/main/scala/org/apache/spark/sql/SQLConf.scala 27 additions, 0 deletionssql/core/src/main/scala/org/apache/spark/sql/SQLConf.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/Exchange.scala 206 additions, 11 deletions.../main/scala/org/apache/spark/sql/execution/Exchange.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/ExchangeCoordinator.scala 260 additions, 0 deletions.../org/apache/spark/sql/execution/ExchangeCoordinator.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/ShuffledRowRDD.scala 111 additions, 23 deletions...scala/org/apache/spark/sql/execution/ShuffledRowRDD.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/ExchangeCoordinatorSuite.scala 479 additions, 0 deletions...apache/spark/sql/execution/ExchangeCoordinatorSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/PlannerSuite.scala 4 additions, 4 deletions...t/scala/org/apache/spark/sql/execution/PlannerSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/UnsafeRowSerializerSuite.scala 6 additions, 1 deletion...apache/spark/sql/execution/UnsafeRowSerializerSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/joins/InnerJoinSuite.scala 14 additions, 5 deletions...org/apache/spark/sql/execution/joins/InnerJoinSuite.scala
Loading
Please register or sign in to comment