Skip to content
Snippets Groups Projects
Commit 482d361c authored by Tathagata Das's avatar Tathagata Das
Browse files

[SPARK-19314][SS][CATALYST] Do not allow sort before aggregation in Structured Streaming plan


## What changes were proposed in this pull request?

Sort in a streaming plan should be allowed only after a aggregation in complete mode. Currently it is incorrectly allowed when present anywhere in the plan. It gives unpredictable potentially incorrect results.

## How was this patch tested?
New test

Author: Tathagata Das <tathagata.das1565@gmail.com>

Closes #16662 from tdas/SPARK-19314.

(cherry picked from commit 552e5f08)
Signed-off-by: default avatarTathagata Das <tathagata.das1565@gmail.com>
parent 7bc3e9ba
No related branches found
No related tags found
No related merge requests found
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment