-
- Downloads
[SPARK-4964] [Streaming] refactor createRDD to take leaders via map instead of array
Author: cody koeninger <cody@koeninger.org> Closes #4511 from koeninger/kafkaRdd-leader-to-broker and squashes the following commits: f7151d4 [cody koeninger] [SPARK-4964] test refactoring 6f8680b [cody koeninger] [SPARK-4964] add test of the scala api for KafkaUtils.createRDD f81e016 [cody koeninger] [SPARK-4964] leave KafkaStreamSuite host and port as private 5173f3f [cody koeninger] [SPARK-4964] test the Java variations of createRDD e9cece4 [cody koeninger] [SPARK-4964] pass leaders as a map to ensure 1 leader per TopicPartition
Showing
- external/kafka/src/main/scala/org/apache/spark/streaming/kafka/Broker.scala 34 additions, 23 deletions.../main/scala/org/apache/spark/streaming/kafka/Broker.scala
- external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala 30 additions, 14 deletions...n/scala/org/apache/spark/streaming/kafka/KafkaUtils.scala
- external/kafka/src/test/java/org/apache/spark/streaming/kafka/JavaKafkaRDDSuite.java 156 additions, 0 deletions...a/org/apache/spark/streaming/kafka/JavaKafkaRDDSuite.java
- external/kafka/src/test/scala/org/apache/spark/streaming/kafka/KafkaRDDSuite.scala 67 additions, 29 deletions...cala/org/apache/spark/streaming/kafka/KafkaRDDSuite.scala
Loading
Please register or sign in to comment