-
- Downloads
[SPARK-18120][SPARK-19557][SQL] Call QueryExecutionListener callback methods...
[SPARK-18120][SPARK-19557][SQL] Call QueryExecutionListener callback methods for DataFrameWriter methods ## What changes were proposed in this pull request? We only notify `QueryExecutionListener` for several `Dataset` operations, e.g. collect, take, etc. We should also do the notification for `DataFrameWriter` operations. ## How was this patch tested? new regression test close https://github.com/apache/spark/pull/16664 Author: Wenchen Fan <wenchen@databricks.com> Closes #16962 from cloud-fan/insert.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala 35 additions, 14 deletions...src/main/scala/org/apache/spark/sql/DataFrameWriter.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/SaveIntoDataSourceCommand.scala 52 additions, 0 deletions...sql/execution/datasources/SaveIntoDataSourceCommand.scala
- sql/core/src/test/scala/org/apache/spark/sql/util/DataFrameCallbackSuite.scala 55 additions, 2 deletions...la/org/apache/spark/sql/util/DataFrameCallbackSuite.scala
Loading
Please register or sign in to comment