-
- Downloads
[SPARK-3027] TaskContext: tighten visibility and provide Java friendly callback API
Note this also passes the TaskContext itself to the TaskCompletionListener. In the future we can mark TaskContext with the exception object if exception occurs during task execution. Author: Reynold Xin <rxin@apache.org> Closes #1938 from rxin/TaskContext and squashes the following commits: 145de43 [Reynold Xin] Added JavaTaskCompletionListenerImpl for Java API friendly guarantee. f435ea5 [Reynold Xin] Added license header for TaskCompletionListener. dc4ed27 [Reynold Xin] [SPARK-3027] TaskContext: tighten the visibility and provide Java friendly callback API
Showing
- core/src/main/scala/org/apache/spark/InterruptibleIterator.scala 1 addition, 1 deletion...c/main/scala/org/apache/spark/InterruptibleIterator.scala
- core/src/main/scala/org/apache/spark/TaskContext.scala 56 additions, 7 deletionscore/src/main/scala/org/apache/spark/TaskContext.scala
- core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala 6 additions, 6 deletions...rc/main/scala/org/apache/spark/api/python/PythonRDD.scala
- core/src/main/scala/org/apache/spark/rdd/CheckpointRDD.scala 1 addition, 1 deletioncore/src/main/scala/org/apache/spark/rdd/CheckpointRDD.scala
- core/src/main/scala/org/apache/spark/rdd/HadoopRDD.scala 1 addition, 1 deletioncore/src/main/scala/org/apache/spark/rdd/HadoopRDD.scala
- core/src/main/scala/org/apache/spark/rdd/JdbcRDD.scala 1 addition, 1 deletioncore/src/main/scala/org/apache/spark/rdd/JdbcRDD.scala
- core/src/main/scala/org/apache/spark/rdd/NewHadoopRDD.scala 1 addition, 1 deletioncore/src/main/scala/org/apache/spark/rdd/NewHadoopRDD.scala
- core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala 1 addition, 1 deletion.../main/scala/org/apache/spark/scheduler/DAGScheduler.scala
- core/src/main/scala/org/apache/spark/scheduler/ResultTask.scala 1 addition, 1 deletion...rc/main/scala/org/apache/spark/scheduler/ResultTask.scala
- core/src/main/scala/org/apache/spark/scheduler/ShuffleMapTask.scala 1 addition, 1 deletion...ain/scala/org/apache/spark/scheduler/ShuffleMapTask.scala
- core/src/main/scala/org/apache/spark/scheduler/Task.scala 1 addition, 1 deletioncore/src/main/scala/org/apache/spark/scheduler/Task.scala
- core/src/main/scala/org/apache/spark/util/TaskCompletionListener.scala 33 additions, 0 deletions.../scala/org/apache/spark/util/TaskCompletionListener.scala
- core/src/test/java/org/apache/spark/util/JavaTaskCompletionListenerImpl.java 39 additions, 0 deletions...org/apache/spark/util/JavaTaskCompletionListenerImpl.java
- core/src/test/scala/org/apache/spark/scheduler/TaskContextSuite.scala 1 addition, 1 deletion...t/scala/org/apache/spark/scheduler/TaskContextSuite.scala
Loading
Please register or sign in to comment