-
- Downloads
[SPARK-3454] separate json endpoints for data in the UI
Exposes data available in the UI as json over http. Key points: * new endpoints, handled independently of existing XyzPage classes. Root entrypoint is `JsonRootResource` * Uses jersey + jackson for routing & converting POJOs into json * tests against known results in `HistoryServerSuite` * also fixes some minor issues w/ the UI -- synchronizing on access to `StorageListener` & `StorageStatusListener`, and fixing some inconsistencies w/ the way we handle retained jobs & stages. Author: Imran Rashid <irashid@cloudera.com> Closes #5940 from squito/SPARK-3454_better_test_files and squashes the following commits: 1a72ed6 [Imran Rashid] rats 85fdb3e [Imran Rashid] Merge branch 'no_php' into SPARK-3454 1fc65b0 [Imran Rashid] Revert "Revert "[SPARK-3454] separate json endpoints for data in the UI"" 1276900 [Imran Rashid] get rid of giant event file, replace w/ smaller one; check both shuffle read & shuffle write 4e12013 [Imran Rashid] just use test case name for expectation file name 863ef64 [Imran Rashid] rename json files to avoid strange file names and not look like php
Showing
- .rat-excludes 7 additions, 0 deletions.rat-excludes
- core/pom.xml 8 additions, 0 deletionscore/pom.xml
- core/src/main/java/org/apache/spark/JobExecutionStatus.java 7 additions, 1 deletioncore/src/main/java/org/apache/spark/JobExecutionStatus.java
- core/src/main/java/org/apache/spark/status/api/v1/ApplicationStatus.java 30 additions, 0 deletions...ava/org/apache/spark/status/api/v1/ApplicationStatus.java
- core/src/main/java/org/apache/spark/status/api/v1/StageStatus.java 31 additions, 0 deletions...main/java/org/apache/spark/status/api/v1/StageStatus.java
- core/src/main/java/org/apache/spark/status/api/v1/TaskSorting.java 48 additions, 0 deletions...main/java/org/apache/spark/status/api/v1/TaskSorting.java
- core/src/main/java/org/apache/spark/util/EnumUtil.java 38 additions, 0 deletionscore/src/main/java/org/apache/spark/util/EnumUtil.java
- core/src/main/scala/org/apache/spark/SparkContext.scala 1 addition, 1 deletioncore/src/main/scala/org/apache/spark/SparkContext.scala
- core/src/main/scala/org/apache/spark/deploy/history/ApplicationHistoryProvider.scala 2 additions, 2 deletions...che/spark/deploy/history/ApplicationHistoryProvider.scala
- core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala 6 additions, 8 deletions...a/org/apache/spark/deploy/history/FsHistoryProvider.scala
- core/src/main/scala/org/apache/spark/deploy/history/HistoryServer.scala 17 additions, 3 deletions...scala/org/apache/spark/deploy/history/HistoryServer.scala
- core/src/main/scala/org/apache/spark/deploy/master/ApplicationInfo.scala 1 addition, 1 deletion...cala/org/apache/spark/deploy/master/ApplicationInfo.scala
- core/src/main/scala/org/apache/spark/deploy/master/Master.scala 7 additions, 7 deletions...rc/main/scala/org/apache/spark/deploy/master/Master.scala
- core/src/main/scala/org/apache/spark/deploy/master/ui/ApplicationPage.scala 1 addition, 18 deletions...a/org/apache/spark/deploy/master/ui/ApplicationPage.scala
- core/src/main/scala/org/apache/spark/deploy/master/ui/MasterPage.scala 7 additions, 5 deletions.../scala/org/apache/spark/deploy/master/ui/MasterPage.scala
- core/src/main/scala/org/apache/spark/deploy/master/ui/MasterWebUI.scala 23 additions, 1 deletion...scala/org/apache/spark/deploy/master/ui/MasterWebUI.scala
- core/src/main/scala/org/apache/spark/status/api/v1/AllJobsResource.scala 98 additions, 0 deletions...cala/org/apache/spark/status/api/v1/AllJobsResource.scala
- core/src/main/scala/org/apache/spark/status/api/v1/AllRDDResource.scala 104 additions, 0 deletions...scala/org/apache/spark/status/api/v1/AllRDDResource.scala
- core/src/main/scala/org/apache/spark/status/api/v1/AllStagesResource.scala 309 additions, 0 deletions...la/org/apache/spark/status/api/v1/AllStagesResource.scala
- core/src/main/scala/org/apache/spark/status/api/v1/ApplicationListResource.scala 94 additions, 0 deletions.../apache/spark/status/api/v1/ApplicationListResource.scala
Loading
Please register or sign in to comment