-
- Downloads
[SPARK-17926][SQL][STREAMING] Added json for statuses
## What changes were proposed in this pull request? StreamingQueryStatus exposed through StreamingQueryListener often needs to be recorded (similar to SparkListener events). This PR adds `.json` and `.prettyJson` to `StreamingQueryStatus`, `SourceStatus` and `SinkStatus`. ## How was this patch tested? New unit tests Author: Tathagata Das <tathagata.das1565@gmail.com> Closes #15476 from tdas/SPARK-17926.
Showing
- python/pyspark/sql/streaming.py 5 additions, 6 deletionspython/pyspark/sql/streaming.py
- sql/core/src/main/scala/org/apache/spark/sql/streaming/SinkStatus.scala 17 additions, 1 deletion...ain/scala/org/apache/spark/sql/streaming/SinkStatus.scala
- sql/core/src/main/scala/org/apache/spark/sql/streaming/SourceStatus.scala 21 additions, 2 deletions...n/scala/org/apache/spark/sql/streaming/SourceStatus.scala
- sql/core/src/main/scala/org/apache/spark/sql/streaming/StreamingQueryStatus.scala 39 additions, 16 deletions...org/apache/spark/sql/streaming/StreamingQueryStatus.scala
- sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQueryStatusSuite.scala 105 additions, 0 deletions...pache/spark/sql/streaming/StreamingQueryStatusSuite.scala
Loading
Please register or sign in to comment