-
- Downloads
SPARK-4682 [CORE] Consolidate various 'Clock' classes
Another one from JoshRosen 's wish list. The first commit is much smaller and removes 2 of the 4 Clock classes. The second is much larger, necessary for consolidating the streaming one. I put together implementations in the way that seemed simplest. Almost all the change is standardizing class and method names. Author: Sean Owen <sowen@cloudera.com> Closes #4514 from srowen/SPARK-4682 and squashes the following commits: 5ed3a03 [Sean Owen] Javadoc Clock classes; make ManualClock private[spark] 169dd13 [Sean Owen] Add support for legacy org.apache.spark.streaming clock class names 277785a [Sean Owen] Reduce the net change in this patch by reversing some unnecessary syntax changes along the way b5e53df [Sean Owen] FakeClock -> ManualClock; getTime() -> getTimeMillis() 160863a [Sean Owen] Consolidate Streaming Clock class into common util Clock 7c956b2 [Sean Owen] Consolidate Clocks except for Streaming Clock
Showing
- core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala 2 additions, 26 deletions...in/scala/org/apache/spark/ExecutorAllocationManager.scala
- core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala 5 additions, 12 deletions...n/scala/org/apache/spark/deploy/worker/DriverRunner.scala
- core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala 10 additions, 10 deletions.../main/scala/org/apache/spark/scheduler/DAGScheduler.scala
- core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala 8 additions, 8 deletions...ain/scala/org/apache/spark/scheduler/TaskSetManager.scala
- core/src/main/scala/org/apache/spark/util/Clock.scala 41 additions, 3 deletionscore/src/main/scala/org/apache/spark/util/Clock.scala
- core/src/main/scala/org/apache/spark/util/ManualClock.scala 69 additions, 0 deletionscore/src/main/scala/org/apache/spark/util/ManualClock.scala
- core/src/test/scala/org/apache/spark/ExecutorAllocationManagerSuite.scala 33 additions, 32 deletions...ala/org/apache/spark/ExecutorAllocationManagerSuite.scala
- core/src/test/scala/org/apache/spark/deploy/worker/DriverRunnerTest.scala 2 additions, 1 deletion...ala/org/apache/spark/deploy/worker/DriverRunnerTest.scala
- core/src/test/scala/org/apache/spark/scheduler/TaskSetManagerSuite.scala 18 additions, 18 deletions...cala/org/apache/spark/scheduler/TaskSetManagerSuite.scala
- core/src/test/scala/org/apache/spark/util/FakeClock.scala 0 additions, 26 deletionscore/src/test/scala/org/apache/spark/util/FakeClock.scala
- external/flume/src/test/java/org/apache/spark/streaming/LocalJavaStreamingContext.java 1 addition, 1 deletion...org/apache/spark/streaming/LocalJavaStreamingContext.java
- external/flume/src/test/scala/org/apache/spark/streaming/flume/FlumePollingStreamSuite.scala 3 additions, 4 deletions...pache/spark/streaming/flume/FlumePollingStreamSuite.scala
- external/mqtt/src/test/java/org/apache/spark/streaming/LocalJavaStreamingContext.java 1 addition, 1 deletion...org/apache/spark/streaming/LocalJavaStreamingContext.java
- external/twitter/src/test/java/org/apache/spark/streaming/LocalJavaStreamingContext.java 1 addition, 1 deletion...org/apache/spark/streaming/LocalJavaStreamingContext.java
- external/zeromq/src/test/java/org/apache/spark/streaming/LocalJavaStreamingContext.java 1 addition, 1 deletion...org/apache/spark/streaming/LocalJavaStreamingContext.java
- extras/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisCheckpointState.scala 4 additions, 6 deletions...ache/spark/streaming/kinesis/KinesisCheckpointState.scala
- extras/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisRecordProcessor.scala 1 addition, 1 deletion...ache/spark/streaming/kinesis/KinesisRecordProcessor.scala
- extras/kinesis-asl/src/test/scala/org/apache/spark/streaming/kinesis/KinesisReceiverSuite.scala 12 additions, 13 deletions...apache/spark/streaming/kinesis/KinesisReceiverSuite.scala
- mllib/src/test/java/org/apache/spark/ml/classification/JavaStreamingLogisticRegressionSuite.java 1 addition, 1 deletion.../classification/JavaStreamingLogisticRegressionSuite.java
- mllib/src/test/java/org/apache/spark/mllib/regression/JavaStreamingLinearRegressionSuite.java 1 addition, 1 deletion.../mllib/regression/JavaStreamingLinearRegressionSuite.java
Loading
Please register or sign in to comment