-
- Downloads
[SPARK-8372] Do not show applications that haven't recorded their app ID yet.
Showing these applications may lead to weird behavior in the History Server. For old logs, if the app ID is recorded later, you may end up with a duplicate entry. For new logs, the app might be listed with a ".inprogress" suffix. So ignore those, but still allow old applications that don't record app IDs at all (1.0 and 1.1) to be shown. Author: Marcelo Vanzin <vanzin@cloudera.com> Author: Carson Wang <carson.wang@intel.com> Closes #7097 from vanzin/SPARK-8372 and squashes the following commits: a24eab2 [Marcelo Vanzin] Feedback. 112ae8f [Marcelo Vanzin] Merge branch 'master' into SPARK-8372 7b91b74 [Marcelo Vanzin] Handle logs generated by 1.0 and 1.1. 1eca3fe [Carson Wang] [SPARK-8372] History server shows incorrect information for application not started
Showing
- core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala 65 additions, 33 deletions...a/org/apache/spark/deploy/history/FsHistoryProvider.scala
- core/src/test/scala/org/apache/spark/deploy/history/FsHistoryProviderSuite.scala 82 additions, 27 deletions.../apache/spark/deploy/history/FsHistoryProviderSuite.scala
Loading
Please register or sign in to comment