-
- Downloads
[SPARK-17510][STREAMING][KAFKA] config max rate on a per-partition basis
## What changes were proposed in this pull request? Allow configuration of max rate on a per-topicpartition basis. ## How was this patch tested? Unit tests. The reporter (Jeff Nadler) said he could test on his workload, so let's wait on that report. Author: cody koeninger <cody@koeninger.org> Closes #15132 from koeninger/SPARK-17510. (cherry picked from commit 89d1fa58) Signed-off-by:Shixiong Zhu <shixiong@databricks.com>
Showing
- external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/DirectKafkaInputDStream.scala 5 additions, 6 deletions...he/spark/streaming/kafka010/DirectKafkaInputDStream.scala
- external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/KafkaUtils.scala 52 additions, 1 deletion...cala/org/apache/spark/streaming/kafka010/KafkaUtils.scala
- external/kafka-0-10/src/main/scala/org/apache/spark/streaming/kafka010/PerPartitionConfig.scala 47 additions, 0 deletions.../apache/spark/streaming/kafka010/PerPartitionConfig.scala
- external/kafka-0-10/src/test/scala/org/apache/spark/streaming/kafka010/DirectKafkaStreamSuite.scala 25 additions, 9 deletions...che/spark/streaming/kafka010/DirectKafkaStreamSuite.scala
- external/kafka-0-8/src/main/scala/org/apache/spark/streaming/kafka/DirectKafkaInputDStream.scala 2 additions, 2 deletions...pache/spark/streaming/kafka/DirectKafkaInputDStream.scala
Loading
Please register or sign in to comment