-
- Downloads
[SPARK-4163][Core][WebUI] Send the fetch failure message back to Web UI
This is a PR to send the fetch failure message back to Web UI. Before:   After (Please ignore the meaning of exception, I threw it in the code directly because it's hard to simulate a fetch failure):   Author: zsxwing <zsxwing@gmail.com> Closes #3032 from zsxwing/SPARK-4163 and squashes the following commits: f7e1faf [zsxwing] Discard changes for FetchFailedException and minor modification 4e946f7 [zsxwing] Add e as the cause of SparkException 316767d [zsxwing] Add private[storage] to FetchResult d51b0b6 [zsxwing] Set e as the cause of FetchFailedException b88c919 [zsxwing] Use 'private[storage]' for case classes instead of 'sealed' 62103fd [zsxwing] Update as per review 0c07d1f [zsxwing] Backward-compatible support a3bca65 [zsxwing] Send the fetch failure message back to Web UI
Showing
- core/src/main/scala/org/apache/spark/TaskEndReason.scala 4 additions, 2 deletionscore/src/main/scala/org/apache/spark/TaskEndReason.scala
- core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala 2 additions, 2 deletions.../main/scala/org/apache/spark/scheduler/DAGScheduler.scala
- core/src/main/scala/org/apache/spark/scheduler/JobLogger.scala 1 addition, 1 deletion...src/main/scala/org/apache/spark/scheduler/JobLogger.scala
- core/src/main/scala/org/apache/spark/shuffle/FetchFailedException.scala 6 additions, 10 deletions...scala/org/apache/spark/shuffle/FetchFailedException.scala
- core/src/main/scala/org/apache/spark/shuffle/hash/BlockStoreShuffleFetcher.scala 8 additions, 6 deletions.../apache/spark/shuffle/hash/BlockStoreShuffleFetcher.scala
- core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala 52 additions, 30 deletions...rg/apache/spark/storage/ShuffleBlockFetcherIterator.scala
- core/src/main/scala/org/apache/spark/util/JsonProtocol.scala 5 additions, 2 deletionscore/src/main/scala/org/apache/spark/util/JsonProtocol.scala
- core/src/main/scala/org/apache/spark/util/Utils.scala 1 addition, 1 deletioncore/src/main/scala/org/apache/spark/util/Utils.scala
- core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala 5 additions, 5 deletions.../scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala
- core/src/test/scala/org/apache/spark/storage/ShuffleBlockFetcherIteratorSuite.scala 4 additions, 4 deletions...ache/spark/storage/ShuffleBlockFetcherIteratorSuite.scala
- core/src/test/scala/org/apache/spark/ui/jobs/JobProgressListenerSuite.scala 1 addition, 1 deletion...a/org/apache/spark/ui/jobs/JobProgressListenerSuite.scala
- core/src/test/scala/org/apache/spark/util/JsonProtocolSuite.scala 3 additions, 1 deletion.../test/scala/org/apache/spark/util/JsonProtocolSuite.scala
Loading
Please register or sign in to comment