Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

S

spark
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Wiki
- Releases
- Model registry
- Environments
- Incidents

Snippets Groups Projects

0b7a132d

Commit 0b7a132d authored 11 years ago by Tathagata Das

Downloads
- Patches
- Plain Diff

Modified checkpoing file clearing policy.

parent ac1f4b06

No related branches found

No related tags found

No related merge requests found

Changes 7

Hide whitespace changes

Inline Side-by-side

Showing

streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala 5 additions, 2 deletions

...rc/main/scala/org/apache/spark/streaming/Checkpoint.scala
streaming/src/main/scala/org/apache/spark/streaming/DStream.scala 10 additions, 5 deletions

...g/src/main/scala/org/apache/spark/streaming/DStream.scala
streaming/src/main/scala/org/apache/spark/streaming/DStreamCheckpointData.scala 44 additions, 19 deletions

...la/org/apache/spark/streaming/DStreamCheckpointData.scala
streaming/src/main/scala/org/apache/spark/streaming/DStreamGraph.scala 19 additions, 11 deletions

.../main/scala/org/apache/spark/streaming/DStreamGraph.scala
streaming/src/main/scala/org/apache/spark/streaming/dstream/FileInputDStream.scala 4 additions, 4 deletions

...org/apache/spark/streaming/dstream/FileInputDStream.scala
streaming/src/main/scala/org/apache/spark/streaming/scheduler/JobGenerator.scala 17 additions, 6 deletions

...a/org/apache/spark/streaming/scheduler/JobGenerator.scala
streaming/src/test/scala/org/apache/spark/streaming/CheckpointSuite.scala 5 additions, 5 deletions

...st/scala/org/apache/spark/streaming/CheckpointSuite.scala

with 104 additions and 52 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment