Skip to content
Snippets Groups Projects
Commit 0fb73253 authored by Jose Torres's avatar Jose Torres Committed by Tathagata Das
Browse files

[SPARK-21587][SS] Added filter pushdown through watermarks. 

## What changes were proposed in this pull request?

Push filter predicates through EventTimeWatermark if they're deterministic and do not reference the watermarked attribute. (This is similar but not identical to the logic for pushing through UnaryNode.)

## How was this patch tested?
unit tests

Author: Jose Torres <joseph-torres@databricks.com>

Closes #18790 from joseph-torres/SPARK-21587.
parent 2d799d08
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment