-
- Downloads
[SPARK-8372] History server shows incorrect information for application not started
The history server may show an incorrect App ID for an incomplete application like <App ID>.inprogress. This app info will never disappear even after the app is completed.  The cause of the issue is that a log path name is used as the app id when app id cannot be got during replay. Author: Carson Wang <carson.wang@intel.com> Closes #6827 from carsonwang/SPARK-8372 and squashes the following commits: cdbb089 [Carson Wang] Fix code style 3e46b35 [Carson Wang] Update code style 90f5dde [Carson Wang] Add a unit test d8c9cd0 [Carson Wang] Replaying events only return information when app is started
Showing
- core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala 23 additions, 15 deletions...a/org/apache/spark/deploy/history/FsHistoryProvider.scala
- core/src/test/scala/org/apache/spark/deploy/history/FsHistoryProviderSuite.scala 30 additions, 13 deletions.../apache/spark/deploy/history/FsHistoryProviderSuite.scala
Loading
Please register or sign in to comment