Skip to content
Snippets Groups Projects
Commit 10423258 authored by cody koeninger's avatar cody koeninger Committed by Shixiong Zhu
Browse files

[SPARK-17813][SQL][KAFKA] Maximum data per trigger 

## What changes were proposed in this pull request?

maxOffsetsPerTrigger option for rate limiting, proportionally based on volume of different topicpartitions.

## How was this patch tested?

Added unit test

Author: cody koeninger <cody@koeninger.org>

Closes #15527 from koeninger/SPARK-17813.
parent 701a9d36
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment