Skip to content
Snippets Groups Projects
  • saturday_s's avatar
    ce99f51d
    [SPARK-18537][WEB UI] Add a REST api to serve spark streaming information · ce99f51d
    saturday_s authored
    ## What changes were proposed in this pull request?
    
    This PR is an inheritance from #16000, and is a completion of #15904.
    
    **Description**
    
    - Augment the `org.apache.spark.status.api.v1` package for serving streaming information.
    - Retrieve the streaming information through StreamingJobProgressListener.
    
    > this api should cover exceptly the same amount of information as you can get from the web interface
    > the implementation is base on the current REST implementation of spark-core
    > and will be available for running applications only
    >
    > https://issues.apache.org/jira/browse/SPARK-18537
    
    ## How was this patch tested?
    
    Local test.
    
    Author: saturday_s <shi.indetail@gmail.com>
    Author: Chan Chor Pang <ChorPang.Chan@access-company.com>
    Author: peterCPChan <universknight@gmail.com>
    
    Closes #16253 from saturday-shi/SPARK-18537.
    ce99f51d
    History
    [SPARK-18537][WEB UI] Add a REST api to serve spark streaming information
    saturday_s authored
    ## What changes were proposed in this pull request?
    
    This PR is an inheritance from #16000, and is a completion of #15904.
    
    **Description**
    
    - Augment the `org.apache.spark.status.api.v1` package for serving streaming information.
    - Retrieve the streaming information through StreamingJobProgressListener.
    
    > this api should cover exceptly the same amount of information as you can get from the web interface
    > the implementation is base on the current REST implementation of spark-core
    > and will be available for running applications only
    >
    > https://issues.apache.org/jira/browse/SPARK-18537
    
    ## How was this patch tested?
    
    Local test.
    
    Author: saturday_s <shi.indetail@gmail.com>
    Author: Chan Chor Pang <ChorPang.Chan@access-company.com>
    Author: peterCPChan <universknight@gmail.com>
    
    Closes #16253 from saturday-shi/SPARK-18537.