-
- Downloads
[SPARK-13165][STREAMING] Replace deprecated synchronizedBuffer in streaming
Building with Scala 2.11 results in the warning trait SynchronizedBuffer in package mutable is deprecated: Synchronization via traits is deprecated as it is inherently unreliable. Consider java.util.concurrent.ConcurrentLinkedQueue as an alternative - we already use ConcurrentLinkedQueue elsewhere so lets replace it. Some notes about how behaviour is different for reviewers: The Seq from a SynchronizedBuffer that was implicitly converted would continue to receive updates - however when we do the same conversion explicitly on the ConcurrentLinkedQueue this isn't the case. Hence changing some of the (internal & test) APIs to pass an Iterable. toSeq is safe to use if there are no more updates. Author: Holden Karau <holden@us.ibm.com> Author: tedyu <yuzhihong@gmail.com> Closes #11067 from holdenk/SPARK-13165-replace-deprecated-synchronizedBuffer-in-streaming.
Showing
- external/flume/src/test/scala/org/apache/spark/streaming/TestOutputStream.scala 3 additions, 2 deletions...t/scala/org/apache/spark/streaming/TestOutputStream.scala
- external/flume/src/test/scala/org/apache/spark/streaming/flume/FlumePollingStreamSuite.scala 6 additions, 7 deletions...pache/spark/streaming/flume/FlumePollingStreamSuite.scala
- external/flume/src/test/scala/org/apache/spark/streaming/flume/FlumeStreamSuite.scala 8 additions, 8 deletions...a/org/apache/spark/streaming/flume/FlumeStreamSuite.scala
- external/kafka/src/test/scala/org/apache/spark/streaming/kafka/DirectKafkaStreamSuite.scala 21 additions, 22 deletions...apache/spark/streaming/kafka/DirectKafkaStreamSuite.scala
- streaming/src/main/scala/org/apache/spark/streaming/receiver/ReceiverSupervisorImpl.scala 9 additions, 8 deletions...che/spark/streaming/receiver/ReceiverSupervisorImpl.scala
- streaming/src/main/scala/org/apache/spark/streaming/ui/BatchPage.scala 1 addition, 1 deletion.../main/scala/org/apache/spark/streaming/ui/BatchPage.scala
- streaming/src/main/scala/org/apache/spark/streaming/ui/BatchUIData.scala 1 addition, 1 deletion...ain/scala/org/apache/spark/streaming/ui/BatchUIData.scala
- streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingJobProgressListener.scala 12 additions, 9 deletions...che/spark/streaming/ui/StreamingJobProgressListener.scala
- streaming/src/test/java/org/apache/spark/streaming/JavaTestUtils.scala 2 additions, 2 deletions.../test/java/org/apache/spark/streaming/JavaTestUtils.scala
- streaming/src/test/scala/org/apache/spark/streaming/BasicOperationsSuite.scala 14 additions, 10 deletions...ala/org/apache/spark/streaming/BasicOperationsSuite.scala
- streaming/src/test/scala/org/apache/spark/streaming/CheckpointSuite.scala 12 additions, 10 deletions...st/scala/org/apache/spark/streaming/CheckpointSuite.scala
- streaming/src/test/scala/org/apache/spark/streaming/InputStreamsSuite.scala 34 additions, 38 deletions.../scala/org/apache/spark/streaming/InputStreamsSuite.scala
- streaming/src/test/scala/org/apache/spark/streaming/MapWithStateSuite.scala 5 additions, 5 deletions.../scala/org/apache/spark/streaming/MapWithStateSuite.scala
- streaming/src/test/scala/org/apache/spark/streaming/MasterFailureTest.scala 5 additions, 4 deletions.../scala/org/apache/spark/streaming/MasterFailureTest.scala
- streaming/src/test/scala/org/apache/spark/streaming/StreamingListenerSuite.scala 43 additions, 46 deletions...a/org/apache/spark/streaming/StreamingListenerSuite.scala
- streaming/src/test/scala/org/apache/spark/streaming/TestSuiteBase.scala 18 additions, 18 deletions...test/scala/org/apache/spark/streaming/TestSuiteBase.scala
- streaming/src/test/scala/org/apache/spark/streaming/receiver/BlockGeneratorSuite.scala 19 additions, 13 deletions...apache/spark/streaming/receiver/BlockGeneratorSuite.scala
- streaming/src/test/scala/org/apache/spark/streaming/ui/StreamingJobProgressListenerSuite.scala 1 addition, 1 deletion...park/streaming/ui/StreamingJobProgressListenerSuite.scala
- streaming/src/test/scala/org/apache/spark/streaming/util/RecurringTimerSuite.scala 12 additions, 10 deletions...org/apache/spark/streaming/util/RecurringTimerSuite.scala
Loading
Please register or sign in to comment