-
- Downloads
[SPARK-8404] [STREAMING] [TESTS] Use thread-safe collections to make the tests more reliable
KafkaStreamSuite, DirectKafkaStreamSuite, JavaKafkaStreamSuite and JavaDirectKafkaStreamSuite use non-thread-safe collections to collect data in one thread and check it in another thread. It may fail the tests. This PR changes them to thread-safe collections. Note: I cannot reproduce the test failures in my environment. But at least, this PR should make the tests more reliable. Author: zsxwing <zsxwing@gmail.com> Closes #6852 from zsxwing/fix-KafkaStreamSuite and squashes the following commits: d464211 [zsxwing] Use thread-safe collections to make the tests more reliable
Showing
- external/kafka/src/test/java/org/apache/spark/streaming/kafka/JavaDirectKafkaStreamSuite.java 2 additions, 4 deletions...che/spark/streaming/kafka/JavaDirectKafkaStreamSuite.java
- external/kafka/src/test/java/org/apache/spark/streaming/kafka/JavaKafkaStreamSuite.java 2 additions, 4 deletions...rg/apache/spark/streaming/kafka/JavaKafkaStreamSuite.java
- external/kafka/src/test/scala/org/apache/spark/streaming/kafka/DirectKafkaStreamSuite.scala 8 additions, 6 deletions...apache/spark/streaming/kafka/DirectKafkaStreamSuite.scala
- external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaStreamSuite.scala 2 additions, 5 deletions...a/org/apache/spark/streaming/kafka/KafkaStreamSuite.scala
Loading
Please register or sign in to comment