-
- Downloads
[SPARK-7112][Streaming][WIP] Add a InputInfoTracker to track all the input streams
Author: jerryshao <saisai.shao@intel.com> Author: Saisai Shao <saisai.shao@intel.com> Closes #5680 from jerryshao/SPARK-7111 and squashes the following commits: 339f854 [Saisai Shao] Add an end-to-end test 812bcaf [jerryshao] Continue address the comments abd0036 [jerryshao] Address the comments 727264e [jerryshao] Fix comment typo 6682bef [jerryshao] Fix compile issue 8325787 [jerryshao] Fix rebase issue 17fa251 [jerryshao] Refactor to build InputInfoTracker ee1b536 [jerryshao] Add DirectStreamTracker to track the direct streams
Showing
- streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala 2 additions, 2 deletions...n/scala/org/apache/spark/streaming/StreamingContext.scala
- streaming/src/main/scala/org/apache/spark/streaming/dstream/InputDStream.scala 3 additions, 0 deletions...ala/org/apache/spark/streaming/dstream/InputDStream.scala
- streaming/src/main/scala/org/apache/spark/streaming/dstream/ReceiverInputDStream.scala 5 additions, 4 deletions...apache/spark/streaming/dstream/ReceiverInputDStream.scala
- streaming/src/main/scala/org/apache/spark/streaming/scheduler/BatchInfo.scala 7 additions, 1 deletion...cala/org/apache/spark/streaming/scheduler/BatchInfo.scala
- streaming/src/main/scala/org/apache/spark/streaming/scheduler/InputInfoTracker.scala 62 additions, 0 deletions...g/apache/spark/streaming/scheduler/InputInfoTracker.scala
- streaming/src/main/scala/org/apache/spark/streaming/scheduler/JobGenerator.scala 5 additions, 3 deletions...a/org/apache/spark/streaming/scheduler/JobGenerator.scala
- streaming/src/main/scala/org/apache/spark/streaming/scheduler/JobScheduler.scala 4 additions, 0 deletions...a/org/apache/spark/streaming/scheduler/JobScheduler.scala
- streaming/src/main/scala/org/apache/spark/streaming/scheduler/JobSet.scala 2 additions, 2 deletions...n/scala/org/apache/spark/streaming/scheduler/JobSet.scala
- streaming/src/main/scala/org/apache/spark/streaming/ui/BatchUIData.scala 1 addition, 1 deletion...ain/scala/org/apache/spark/streaming/ui/BatchUIData.scala
- streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingJobProgressListener.scala 18 additions, 13 deletions...che/spark/streaming/ui/StreamingJobProgressListener.scala
- streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingPage.scala 2 additions, 2 deletions...n/scala/org/apache/spark/streaming/ui/StreamingPage.scala
- streaming/src/test/scala/org/apache/spark/streaming/InputStreamsSuite.scala 29 additions, 4 deletions.../scala/org/apache/spark/streaming/InputStreamsSuite.scala
- streaming/src/test/scala/org/apache/spark/streaming/StreamingListenerSuite.scala 15 additions, 0 deletions...a/org/apache/spark/streaming/StreamingListenerSuite.scala
- streaming/src/test/scala/org/apache/spark/streaming/TestSuiteBase.scala 6 additions, 2 deletions...test/scala/org/apache/spark/streaming/TestSuiteBase.scala
- streaming/src/test/scala/org/apache/spark/streaming/scheduler/InputInfoTrackerSuite.scala 79 additions, 0 deletions...che/spark/streaming/scheduler/InputInfoTrackerSuite.scala
- streaming/src/test/scala/org/apache/spark/streaming/ui/StreamingJobProgressListenerSuite.scala 7 additions, 12 deletions...park/streaming/ui/StreamingJobProgressListenerSuite.scala
Loading
Please register or sign in to comment