-
- Downloads
[SPARK-17406][WEB UI] limit timeline executor events
## What changes were proposed in this pull request? The job page will be too slow to open when there are thousands of executor events(added or removed). I found that in ExecutorsTab file, executorIdToData will not remove elements, it will increase all the time.Before this pr, it looks like [timeline1.png](https://issues.apache.org/jira/secure/attachment/12827112/timeline1.png). After this pr, it looks like [timeline2.png](https://issues.apache.org/jira/secure/attachment/12827113/timeline2.png)(we can set how many executor events will be displayed) Author: cenyuhai <cenyuhai@didichuxing.com> Closes #14969 from cenyuhai/SPARK-17406.
Showing
- core/src/main/scala/org/apache/spark/ui/exec/ExecutorsPage.scala 14 additions, 27 deletions...c/main/scala/org/apache/spark/ui/exec/ExecutorsPage.scala
- core/src/main/scala/org/apache/spark/ui/exec/ExecutorsTab.scala 66 additions, 46 deletions...rc/main/scala/org/apache/spark/ui/exec/ExecutorsTab.scala
- core/src/main/scala/org/apache/spark/ui/jobs/AllJobsPage.scala 33 additions, 33 deletions...src/main/scala/org/apache/spark/ui/jobs/AllJobsPage.scala
- core/src/main/scala/org/apache/spark/ui/jobs/ExecutorTable.scala 2 additions, 1 deletion...c/main/scala/org/apache/spark/ui/jobs/ExecutorTable.scala
- core/src/main/scala/org/apache/spark/ui/jobs/JobPage.scala 33 additions, 34 deletionscore/src/main/scala/org/apache/spark/ui/jobs/JobPage.scala
- core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala 2 additions, 2 deletionscore/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala
- core/src/main/scala/org/apache/spark/ui/jobs/UIData.scala 0 additions, 5 deletionscore/src/main/scala/org/apache/spark/ui/jobs/UIData.scala
- project/MimaExcludes.scala 12 additions, 0 deletionsproject/MimaExcludes.scala
Loading
Please register or sign in to comment