-
- Downloads
Fixed bugs in FileInputDStream and Scheduler that occasionally failed to...
Fixed bugs in FileInputDStream and Scheduler that occasionally failed to reprocess old files after recovering from master failure. Completely modified spark.streaming.FailureTest to test multiple master failures using file input stream.
Showing
- streaming/src/main/scala/spark/streaming/DStreamGraph.scala 2 additions, 0 deletionsstreaming/src/main/scala/spark/streaming/DStreamGraph.scala
- streaming/src/main/scala/spark/streaming/JobManager.scala 2 additions, 2 deletionsstreaming/src/main/scala/spark/streaming/JobManager.scala
- streaming/src/main/scala/spark/streaming/Scheduler.scala 6 additions, 2 deletionsstreaming/src/main/scala/spark/streaming/Scheduler.scala
- streaming/src/main/scala/spark/streaming/Time.scala 4 additions, 0 deletionsstreaming/src/main/scala/spark/streaming/Time.scala
- streaming/src/main/scala/spark/streaming/dstream/FileInputDStream.scala 7 additions, 6 deletions...main/scala/spark/streaming/dstream/FileInputDStream.scala
- streaming/src/test/scala/spark/streaming/FailureSuite.scala 200 additions, 81 deletionsstreaming/src/test/scala/spark/streaming/FailureSuite.scala
Loading
Please register or sign in to comment