-
- Downloads
[SPARK-6211][Streaming] Add Python Kafka API unit test
Refactor the Kafka unit test and add Python API support. CC tdas davies please help to review, thanks a lot. Author: jerryshao <saisai.shao@intel.com> Author: Saisai Shao <saisai.shao@intel.com> Closes #4961 from jerryshao/SPARK-6211 and squashes the following commits: ee4b919 [jerryshao] Fixed newly merged issue 82c756e [jerryshao] Address the comments 92912d1 [jerryshao] Address the commits 0708bb1 [jerryshao] Fix rebase issue 40b47a3 [Saisai Shao] Style fix f889657 [Saisai Shao] Update the code according 8a2f3e2 [jerryshao] Address the issues 0f1b7ce [jerryshao] Still fix the bug 61a04f0 [jerryshao] Fix bugs and address the issues 64d9877 [jerryshao] Fix rebase bugs 8ad442f [jerryshao] Add kafka-assembly in run-tests 6020b00 [jerryshao] Add more debug info in Shell 8102d6e [jerryshao] Fix bug in Jenkins test fde1213 [jerryshao] Code style changes 5536f95 [jerryshao] Refactor the Kafka unit test and add Python Kafka unittest support
Showing
- dev/run-tests 1 addition, 1 deletiondev/run-tests
- external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaTestUtils.scala 261 additions, 0 deletions...ala/org/apache/spark/streaming/kafka/KafkaTestUtils.scala
- external/kafka/src/test/java/org/apache/spark/streaming/kafka/JavaDirectKafkaStreamSuite.java 16 additions, 12 deletions...che/spark/streaming/kafka/JavaDirectKafkaStreamSuite.java
- external/kafka/src/test/java/org/apache/spark/streaming/kafka/JavaKafkaRDDSuite.java 16 additions, 12 deletions...a/org/apache/spark/streaming/kafka/JavaKafkaRDDSuite.java
- external/kafka/src/test/java/org/apache/spark/streaming/kafka/JavaKafkaStreamSuite.java 16 additions, 18 deletions...rg/apache/spark/streaming/kafka/JavaKafkaStreamSuite.java
- external/kafka/src/test/scala/org/apache/spark/streaming/kafka/DirectKafkaStreamSuite.scala 33 additions, 23 deletions...apache/spark/streaming/kafka/DirectKafkaStreamSuite.scala
- external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaClusterSuite.scala 18 additions, 11 deletions.../org/apache/spark/streaming/kafka/KafkaClusterSuite.scala
- external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaRDDSuite.scala 24 additions, 16 deletions...cala/org/apache/spark/streaming/kafka/KafkaRDDSuite.scala
- external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaStreamSuite.scala 20 additions, 191 deletions...a/org/apache/spark/streaming/kafka/KafkaStreamSuite.scala
- external/kafka/src/test/scala/org/apache/spark/streaming/kafka/ReliableKafkaStreamSuite.scala 37 additions, 25 deletions...ache/spark/streaming/kafka/ReliableKafkaStreamSuite.scala
- python/pyspark/streaming/tests.py 42 additions, 1 deletionpython/pyspark/streaming/tests.py
- python/run-tests 18 additions, 1 deletionpython/run-tests
Loading
Please register or sign in to comment