-
- Downloads
[SPARK-20702][CORE] TaskContextImpl.markTaskCompleted should not hide the original error
## What changes were proposed in this pull request? This PR adds an `error` parameter to `TaskContextImpl.markTaskCompleted` to propagate the original error. It also fixes an issue that `TaskCompletionListenerException.getMessage` doesn't include `previousError`. ## How was this patch tested? New unit tests. Author: Shixiong Zhu <shixiong@databricks.com> Closes #17942 from zsxwing/SPARK-20702.
Showing
- core/src/main/scala/org/apache/spark/TaskContextImpl.scala 2 additions, 2 deletionscore/src/main/scala/org/apache/spark/TaskContextImpl.scala
- core/src/main/scala/org/apache/spark/scheduler/Task.scala 23 additions, 16 deletionscore/src/main/scala/org/apache/spark/scheduler/Task.scala
- core/src/main/scala/org/apache/spark/util/taskListeners.scala 8 additions, 6 deletions.../src/main/scala/org/apache/spark/util/taskListeners.scala
- core/src/test/scala/org/apache/spark/scheduler/TaskContextSuite.scala 33 additions, 3 deletions...t/scala/org/apache/spark/scheduler/TaskContextSuite.scala
- core/src/test/scala/org/apache/spark/storage/PartiallySerializedBlockSuite.scala 1 addition, 1 deletion.../apache/spark/storage/PartiallySerializedBlockSuite.scala
- core/src/test/scala/org/apache/spark/storage/ShuffleBlockFetcherIteratorSuite.scala 1 addition, 1 deletion...ache/spark/storage/ShuffleBlockFetcherIteratorSuite.scala
Loading
Please register or sign in to comment