-
- Downloads
[SPARK-13146][SQL] Management API for continuous queries
### Management API for Continuous Queries **API for getting status of each query** - Whether active or not - Unique name of each query - Status of the sources and sinks - Exceptions **API for managing each query** - Immediately stop an active query - Waiting for a query to be terminated, correctly or with error **API for managing multiple queries** - Listing all active queries - Getting an active query by name - Waiting for any one of the active queries to be terminated **API for listening to query life cycle events** - ContinuousQueryListener API for query start, progress and termination events. Author: Tathagata Das <tathagata.das1565@gmail.com> Closes #11030 from tdas/streaming-df-management-api.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/ContinuousQuery.scala 71 additions, 1 deletion...src/main/scala/org/apache/spark/sql/ContinuousQuery.scala
- sql/core/src/main/scala/org/apache/spark/sql/ContinuousQueryException.scala 54 additions, 0 deletions...scala/org/apache/spark/sql/ContinuousQueryException.scala
- sql/core/src/main/scala/org/apache/spark/sql/ContinuousQueryManager.scala 193 additions, 0 deletions...n/scala/org/apache/spark/sql/ContinuousQueryManager.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala 13 additions, 1 deletion...src/main/scala/org/apache/spark/sql/DataFrameWriter.scala
- sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala 12 additions, 0 deletions...core/src/main/scala/org/apache/spark/sql/SQLContext.scala
- sql/core/src/main/scala/org/apache/spark/sql/SinkStatus.scala 34 additions, 0 deletions...core/src/main/scala/org/apache/spark/sql/SinkStatus.scala
- sql/core/src/main/scala/org/apache/spark/sql/SourceStatus.scala 34 additions, 0 deletions...re/src/main/scala/org/apache/spark/sql/SourceStatus.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/ContinuousQueryListenerBus.scala 82 additions, 0 deletions.../sql/execution/streaming/ContinuousQueryListenerBus.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala 163 additions, 52 deletions...pache/spark/sql/execution/streaming/StreamExecution.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamProgress.scala 4 additions, 0 deletions...apache/spark/sql/execution/streaming/StreamProgress.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/memory.scala 15 additions, 5 deletions...ala/org/apache/spark/sql/execution/streaming/memory.scala
- sql/core/src/main/scala/org/apache/spark/sql/util/ContinuousQueryListener.scala 67 additions, 0 deletions...a/org/apache/spark/sql/util/ContinuousQueryListener.scala
- sql/core/src/test/scala/org/apache/spark/sql/StreamTest.scala 204 additions, 48 deletions...core/src/test/scala/org/apache/spark/sql/StreamTest.scala
- sql/core/src/test/scala/org/apache/spark/sql/streaming/ContinuousQueryManagerSuite.scala 306 additions, 0 deletions...che/spark/sql/streaming/ContinuousQueryManagerSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/streaming/ContinuousQuerySuite.scala 139 additions, 0 deletions...org/apache/spark/sql/streaming/ContinuousQuerySuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/streaming/DataFrameReaderWriterSuite.scala 67 additions, 2 deletions...ache/spark/sql/streaming/DataFrameReaderWriterSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/util/ContinuousQueryListenerSuite.scala 222 additions, 0 deletions.../apache/spark/sql/util/ContinuousQueryListenerSuite.scala
Loading
Please register or sign in to comment