-
- Downloads
[SPARK-19140][SS] Allow update mode for non-aggregation streaming queries
## What changes were proposed in this pull request? This PR allow update mode for non-aggregation streaming queries. It will be same as the append mode if a query has no aggregations. ## How was this patch tested? Jenkins Author: Shixiong Zhu <shixiong@databricks.com> Closes #16520 from zsxwing/update-without-agg. (cherry picked from commit bc6c56e9) Signed-off-by:Shixiong Zhu <shixiong@databricks.com>
Showing
- docs/structured-streaming-programming-guide.md 2 additions, 2 deletionsdocs/structured-streaming-programming-guide.md
- python/pyspark/sql/streaming.py 19 additions, 8 deletionspython/pyspark/sql/streaming.py
- sql/catalyst/src/main/java/org/apache/spark/sql/streaming/OutputMode.java 2 additions, 1 deletion.../main/java/org/apache/spark/sql/streaming/OutputMode.java
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala 1 addition, 1 deletion...k/sql/catalyst/analysis/UnsupportedOperationChecker.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/streaming/InternalOutputModes.scala 2 additions, 2 deletions...he/spark/sql/catalyst/streaming/InternalOutputModes.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationsSuite.scala 17 additions, 14 deletions...rk/sql/catalyst/analysis/UnsupportedOperationsSuite.scala
- sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamWriter.scala 7 additions, 11 deletions...ala/org/apache/spark/sql/streaming/DataStreamWriter.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/MemorySinkSuite.scala 22 additions, 13 deletions...pache/spark/sql/execution/streaming/MemorySinkSuite.scala
Loading
Please register or sign in to comment