-
- Downloads
[SPARK-9467][SQL]Add SQLMetric to specialize accumulators to avoid boxing
This PR adds SQLMetric/SQLMetricParam/SQLMetricValue to specialize accumulators to avoid boxing. All SQL metrics should use these classes rather than `Accumulator`. Author: zsxwing <zsxwing@gmail.com> Closes #7996 from zsxwing/sql-accu and squashes the following commits: 14a5f0a [zsxwing] Address comments 367ca23 [zsxwing] Use localValue directly to avoid changing Accumulable 42f50c3 [zsxwing] Add SQLMetric to specialize accumulators to avoid boxing
Showing
- core/src/main/scala/org/apache/spark/Accumulators.scala 1 addition, 1 deletioncore/src/main/scala/org/apache/spark/Accumulators.scala
- core/src/main/scala/org/apache/spark/SparkContext.scala 0 additions, 15 deletionscore/src/main/scala/org/apache/spark/SparkContext.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlan.scala 21 additions, 12 deletions...main/scala/org/apache/spark/sql/execution/SparkPlan.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/basicOperators.scala 6 additions, 5 deletions...scala/org/apache/spark/sql/execution/basicOperators.scala
- sql/core/src/main/scala/org/apache/spark/sql/metric/SQLMetrics.scala 149 additions, 0 deletions...c/main/scala/org/apache/spark/sql/metric/SQLMetrics.scala
- sql/core/src/main/scala/org/apache/spark/sql/ui/SQLListener.scala 9 additions, 8 deletions.../src/main/scala/org/apache/spark/sql/ui/SQLListener.scala
- sql/core/src/main/scala/org/apache/spark/sql/ui/SparkPlanGraph.scala 4 additions, 4 deletions...c/main/scala/org/apache/spark/sql/ui/SparkPlanGraph.scala
- sql/core/src/test/scala/org/apache/spark/sql/metric/SQLMetricsSuite.scala 145 additions, 0 deletions...t/scala/org/apache/spark/sql/metric/SQLMetricsSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/ui/SQLListenerSuite.scala 3 additions, 2 deletions...test/scala/org/apache/spark/sql/ui/SQLListenerSuite.scala
Loading
Please register or sign in to comment