-
- Downloads
[SPARK-11155][WEB UI] Stage summary json should include stage duration
The json endpoint for stages doesn't include information on the stage duration that is present in the UI. This looks like a simple oversight, they should be included. eg., the metrics should be included at api/v1/applications/<appId>/stages. Metrics I've added are: submissionTime, firstTaskLaunchedTime and completionTime Author: Xin Ren <iamshrek@126.com> Closes #10107 from keypointt/SPARK-11155.
Showing
- core/src/main/scala/org/apache/spark/status/api/v1/AllStagesResource.scala 13 additions, 1 deletion...la/org/apache/spark/status/api/v1/AllStagesResource.scala
- core/src/main/scala/org/apache/spark/status/api/v1/api.scala 3 additions, 0 deletionscore/src/main/scala/org/apache/spark/status/api/v1/api.scala
- core/src/test/resources/HistoryServerExpectations/complete_stage_list_json_expectation.json 10 additions, 1 deletion...verExpectations/complete_stage_list_json_expectation.json
- core/src/test/resources/HistoryServerExpectations/failed_stage_list_json_expectation.json 4 additions, 1 deletion...erverExpectations/failed_stage_list_json_expectation.json
- core/src/test/resources/HistoryServerExpectations/one_stage_attempt_json_expectation.json 4 additions, 1 deletion...erverExpectations/one_stage_attempt_json_expectation.json
- core/src/test/resources/HistoryServerExpectations/one_stage_json_expectation.json 4 additions, 1 deletion...HistoryServerExpectations/one_stage_json_expectation.json
- core/src/test/resources/HistoryServerExpectations/stage_list_json_expectation.json 13 additions, 1 deletion...istoryServerExpectations/stage_list_json_expectation.json
- core/src/test/resources/HistoryServerExpectations/stage_list_with_accumulable_json_expectation.json 4 additions, 1 deletion...tations/stage_list_with_accumulable_json_expectation.json
- core/src/test/resources/HistoryServerExpectations/stage_with_accumulable_json_expectation.json 4 additions, 1 deletion...Expectations/stage_with_accumulable_json_expectation.json
- core/src/test/scala/org/apache/spark/status/api/v1/AllStagesResourceSuite.scala 62 additions, 0 deletions...g/apache/spark/status/api/v1/AllStagesResourceSuite.scala
- project/MimaExcludes.scala 3 additions, 1 deletionproject/MimaExcludes.scala
Loading
Please register or sign in to comment