-
- Downloads
[SPARK-12221] add cpu time to metrics
Currently task metrics don't support executor CPU time, so there's no way to calculate how much CPU time a stage/task took from History Server metrics. This PR enables reporting CPU time. Author: jisookim <jisookim0513@gmail.com> Closes #10212 from jisookim0513/add-cpu-time-metric.
Showing
- core/src/main/scala/org/apache/spark/InternalAccumulator.scala 2 additions, 0 deletions...src/main/scala/org/apache/spark/InternalAccumulator.scala
- core/src/main/scala/org/apache/spark/executor/Executor.scala 15 additions, 0 deletionscore/src/main/scala/org/apache/spark/executor/Executor.scala
- core/src/main/scala/org/apache/spark/executor/TaskMetrics.scala 18 additions, 0 deletions...rc/main/scala/org/apache/spark/executor/TaskMetrics.scala
- core/src/main/scala/org/apache/spark/scheduler/ResultTask.scala 8 additions, 0 deletions...rc/main/scala/org/apache/spark/scheduler/ResultTask.scala
- core/src/main/scala/org/apache/spark/scheduler/ShuffleMapTask.scala 8 additions, 0 deletions...ain/scala/org/apache/spark/scheduler/ShuffleMapTask.scala
- core/src/main/scala/org/apache/spark/scheduler/Task.scala 2 additions, 0 deletionscore/src/main/scala/org/apache/spark/scheduler/Task.scala
- core/src/main/scala/org/apache/spark/status/api/v1/AllStagesResource.scala 5 additions, 0 deletions...la/org/apache/spark/status/api/v1/AllStagesResource.scala
- core/src/main/scala/org/apache/spark/status/api/v1/api.scala 5 additions, 0 deletionscore/src/main/scala/org/apache/spark/status/api/v1/api.scala
- core/src/main/scala/org/apache/spark/ui/jobs/JobProgressListener.scala 4 additions, 0 deletions.../scala/org/apache/spark/ui/jobs/JobProgressListener.scala
- core/src/main/scala/org/apache/spark/ui/jobs/UIData.scala 5 additions, 0 deletionscore/src/main/scala/org/apache/spark/ui/jobs/UIData.scala
- core/src/main/scala/org/apache/spark/util/JsonProtocol.scala 10 additions, 0 deletionscore/src/main/scala/org/apache/spark/util/JsonProtocol.scala
- core/src/test/resources/HistoryServerExpectations/complete_stage_list_json_expectation.json 3 additions, 0 deletions...verExpectations/complete_stage_list_json_expectation.json
- core/src/test/resources/HistoryServerExpectations/failed_stage_list_json_expectation.json 1 addition, 0 deletions...erverExpectations/failed_stage_list_json_expectation.json
- core/src/test/resources/HistoryServerExpectations/one_stage_attempt_json_expectation.json 17 additions, 0 deletions...erverExpectations/one_stage_attempt_json_expectation.json
- core/src/test/resources/HistoryServerExpectations/one_stage_json_expectation.json 17 additions, 0 deletions...HistoryServerExpectations/one_stage_json_expectation.json
- core/src/test/resources/HistoryServerExpectations/stage_list_json_expectation.json 4 additions, 0 deletions...istoryServerExpectations/stage_list_json_expectation.json
- core/src/test/resources/HistoryServerExpectations/stage_list_with_accumulable_json_expectation.json 1 addition, 0 deletions...tations/stage_list_with_accumulable_json_expectation.json
- core/src/test/resources/HistoryServerExpectations/stage_task_list_expectation.json 40 additions, 0 deletions...istoryServerExpectations/stage_task_list_expectation.json
- core/src/test/resources/HistoryServerExpectations/stage_task_list_from_multi_attempt_app_json_1__expectation.json 16 additions, 0 deletions...task_list_from_multi_attempt_app_json_1__expectation.json
- core/src/test/resources/HistoryServerExpectations/stage_task_list_from_multi_attempt_app_json_2__expectation.json 16 additions, 0 deletions...task_list_from_multi_attempt_app_json_2__expectation.json
Loading
Please register or sign in to comment