-
- Downloads
[SPARK-17672] Spark 2.0 history server web Ui takes too long for a single application
Added a new API getApplicationInfo(appId: String) in class ApplicationHistoryProvider and class SparkUI to get app info. In this change, FsHistoryProvider can directly fetch one app info in O(1) time complexity compared to O(n) before the change which used an Iterator.find() interface. Both ApplicationCache and OneApplicationResource classes adopt this new api. manual tests Author: Gang Wu <wgtmac@uber.com> Closes #15247 from wgtmac/SPARK-17671.
Showing
- core/src/main/scala/org/apache/spark/deploy/history/ApplicationHistoryProvider.scala 5 additions, 0 deletions...che/spark/deploy/history/ApplicationHistoryProvider.scala
- core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala 4 additions, 0 deletions...a/org/apache/spark/deploy/history/FsHistoryProvider.scala
- core/src/main/scala/org/apache/spark/deploy/history/HistoryServer.scala 4 additions, 0 deletions...scala/org/apache/spark/deploy/history/HistoryServer.scala
- core/src/main/scala/org/apache/spark/status/api/v1/ApiRootResource.scala 1 addition, 0 deletions...cala/org/apache/spark/status/api/v1/ApiRootResource.scala
- core/src/main/scala/org/apache/spark/status/api/v1/OneApplicationResource.scala 1 addition, 1 deletion...g/apache/spark/status/api/v1/OneApplicationResource.scala
- core/src/main/scala/org/apache/spark/ui/SparkUI.scala 4 additions, 0 deletionscore/src/main/scala/org/apache/spark/ui/SparkUI.scala
Loading
Please register or sign in to comment