-
- Downloads
[SPARK-14357][CORE] Properly handle the root cause being a commit denied exception
## What changes were proposed in this pull request? When deciding whether a CommitDeniedException caused a task to fail, consider the root cause of the Exception. ## How was this patch tested? Added a test suite for the component that extracts the root cause of the error. Made a distribution after cherry-picking this commit to branch-1.6 and used to run our Spark application that would quite often fail due to the CommitDeniedException. Author: Jason Moore <jasonmoore2k@outlook.com> Closes #12228 from jasonmoore2k/SPARK-14357.
Showing
- core/src/main/scala/org/apache/spark/executor/Executor.scala 1 addition, 1 deletioncore/src/main/scala/org/apache/spark/executor/Executor.scala
- core/src/main/scala/org/apache/spark/util/CausedBy.scala 36 additions, 0 deletionscore/src/main/scala/org/apache/spark/util/CausedBy.scala
- core/src/test/scala/org/apache/spark/util/CausedBySuite.scala 56 additions, 0 deletions.../src/test/scala/org/apache/spark/util/CausedBySuite.scala
Loading
Please register or sign in to comment