-
- Downloads
[SPARK-10071] [STREAMING] Output a warning when writing QueueInputDStream and...
[SPARK-10071] [STREAMING] Output a warning when writing QueueInputDStream and throw a better exception when reading QueueInputDStream Output a warning when serializing QueueInputDStream rather than throwing an exception to allow unit tests use it. Moreover, this PR also throws an better exception when deserializing QueueInputDStream to make the user find out the problem easily. The previous exception is hard to understand: https://issues.apache.org/jira/browse/SPARK-8553 Author: zsxwing <zsxwing@gmail.com> Closes #8624 from zsxwing/SPARK-10071 and squashes the following commits: 847cfa8 [zsxwing] Output a warning when writing QueueInputDStream and throw a better exception when reading QueueInputDStream
Showing
- streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala 4 additions, 2 deletions...rc/main/scala/org/apache/spark/streaming/Checkpoint.scala
- streaming/src/main/scala/org/apache/spark/streaming/dstream/QueueInputDStream.scala 7 additions, 2 deletions...rg/apache/spark/streaming/dstream/QueueInputDStream.scala
- streaming/src/test/scala/org/apache/spark/streaming/StreamingContextSuite.scala 19 additions, 9 deletions...la/org/apache/spark/streaming/StreamingContextSuite.scala
Loading
Please register or sign in to comment