-
- Downloads
[SPARK-6847][CORE][STREAMING] Fix stack overflow issue when updateStateByKey...
[SPARK-6847][CORE][STREAMING] Fix stack overflow issue when updateStateByKey is followed by a checkpointed dstream Add a local property to indicate if checkpointing all RDDs that are marked with the checkpoint flag, and enable it in Streaming Author: Shixiong Zhu <shixiong@databricks.com> Closes #10934 from zsxwing/recursive-checkpoint.
Showing
- core/src/main/scala/org/apache/spark/rdd/RDD.scala 19 additions, 0 deletionscore/src/main/scala/org/apache/spark/rdd/RDD.scala
- core/src/test/scala/org/apache/spark/CheckpointSuite.scala 21 additions, 0 deletionscore/src/test/scala/org/apache/spark/CheckpointSuite.scala
- streaming/src/main/scala/org/apache/spark/streaming/scheduler/JobGenerator.scala 5 additions, 0 deletions...a/org/apache/spark/streaming/scheduler/JobGenerator.scala
- streaming/src/main/scala/org/apache/spark/streaming/scheduler/JobScheduler.scala 5 additions, 2 deletions...a/org/apache/spark/streaming/scheduler/JobScheduler.scala
- streaming/src/test/scala/org/apache/spark/streaming/CheckpointSuite.scala 69 additions, 0 deletions...st/scala/org/apache/spark/streaming/CheckpointSuite.scala
Loading
Please register or sign in to comment