-
- Downloads
[SPARK-19168][STRUCTURED STREAMING] StateStore should be aborted upon error
## What changes were proposed in this pull request? We should call `StateStore.abort()` when there should be any error before the store is committed. ## How was this patch tested? Manually. Author: Liwei Lin <lwlin7@gmail.com> Closes #16547 from lw-lin/append-filter.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StatefulAggregate.scala 8 additions, 0 deletions...che/spark/sql/execution/streaming/StatefulAggregate.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala 1 addition, 1 deletion...cution/streaming/state/HDFSBackedStateStoreProvider.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala 1 addition, 1 deletion...ache/spark/sql/execution/streaming/state/StateStore.scala
Loading
Please register or sign in to comment