Skip to content
Snippets Groups Projects
  • Imran Rashid's avatar
    c796be70
    [SPARK-3454] separate json endpoints for data in the UI · c796be70
    Imran Rashid authored
    Exposes data available in the UI as json over http.  Key points:
    
    * new endpoints, handled independently of existing XyzPage classes.  Root entrypoint is `JsonRootResource`
    * Uses jersey + jackson for routing & converting POJOs into json
    * tests against known results in `HistoryServerSuite`
    * also fixes some minor issues w/ the UI -- synchronizing on access to `StorageListener` & `StorageStatusListener`, and fixing some inconsistencies w/ the way we handle retained jobs & stages.
    
    Author: Imran Rashid <irashid@cloudera.com>
    
    Closes #5940 from squito/SPARK-3454_better_test_files and squashes the following commits:
    
    1a72ed6 [Imran Rashid] rats
    85fdb3e [Imran Rashid] Merge branch 'no_php' into SPARK-3454
    1fc65b0 [Imran Rashid] Revert "Revert "[SPARK-3454] separate json endpoints for data in the UI""
    1276900 [Imran Rashid] get rid of giant event file, replace w/ smaller one; check both shuffle read & shuffle write
    4e12013 [Imran Rashid] just use test case name for expectation file name
    863ef64 [Imran Rashid] rename json files to avoid strange file names and not look like php
    c796be70
    History
    [SPARK-3454] separate json endpoints for data in the UI
    Imran Rashid authored
    Exposes data available in the UI as json over http.  Key points:
    
    * new endpoints, handled independently of existing XyzPage classes.  Root entrypoint is `JsonRootResource`
    * Uses jersey + jackson for routing & converting POJOs into json
    * tests against known results in `HistoryServerSuite`
    * also fixes some minor issues w/ the UI -- synchronizing on access to `StorageListener` & `StorageStatusListener`, and fixing some inconsistencies w/ the way we handle retained jobs & stages.
    
    Author: Imran Rashid <irashid@cloudera.com>
    
    Closes #5940 from squito/SPARK-3454_better_test_files and squashes the following commits:
    
    1a72ed6 [Imran Rashid] rats
    85fdb3e [Imran Rashid] Merge branch 'no_php' into SPARK-3454
    1fc65b0 [Imran Rashid] Revert "Revert "[SPARK-3454] separate json endpoints for data in the UI""
    1276900 [Imran Rashid] get rid of giant event file, replace w/ smaller one; check both shuffle read & shuffle write
    4e12013 [Imran Rashid] just use test case name for expectation file name
    863ef64 [Imran Rashid] rename json files to avoid strange file names and not look like php