-
- Downloads
[SPARK-19549] Allow providing reason for stage/job cancelling
## What changes were proposed in this pull request? This change add an optional argument to `SparkContext.cancelStage()` and `SparkContext.cancelJob()` functions, which allows the caller to provide exact reason for the cancellation. ## How was this patch tested? Adds unit test. Author: Ala Luszczak <ala@databricks.com> Closes #16887 from ala/cancel.
Showing
- core/src/main/scala/org/apache/spark/SparkContext.scala 26 additions, 4 deletionscore/src/main/scala/org/apache/spark/SparkContext.scala
- core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala 21 additions, 14 deletions.../main/scala/org/apache/spark/scheduler/DAGScheduler.scala
- core/src/main/scala/org/apache/spark/scheduler/DAGSchedulerEvent.scala 8 additions, 2 deletions.../scala/org/apache/spark/scheduler/DAGSchedulerEvent.scala
- core/src/main/scala/org/apache/spark/scheduler/JobWaiter.scala 1 addition, 1 deletion...src/main/scala/org/apache/spark/scheduler/JobWaiter.scala
- core/src/test/scala/org/apache/spark/SparkContextSuite.scala 66 additions, 3 deletionscore/src/test/scala/org/apache/spark/SparkContextSuite.scala
- core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala 1 addition, 1 deletion.../scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/DataFrameRangeSuite.scala 15 additions, 4 deletions...test/scala/org/apache/spark/sql/DataFrameRangeSuite.scala
Loading
Please register or sign in to comment