-
- Downloads
[SPARK-20407][TESTS] ParquetQuerySuite 'Enabling/disabling ignoreCorruptFiles' flaky test
## What changes were proposed in this pull request? SharedSQLContext.afterEach now calls DebugFilesystem.assertNoOpenStreams inside eventually. SQLTestUtils withTempDir calls waitForTasksToFinish before deleting the directory. ## How was this patch tested? Added new test in ParquetQuerySuite based on the flaky test Author: Bogdan Raducanu <bogdan@databricks.com> Closes #17701 from bogdanrdc/SPARK-20407.
Showing
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetQuerySuite.scala 34 additions, 1 deletion...sql/execution/datasources/parquet/ParquetQuerySuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala 17 additions, 2 deletions...c/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala
- sql/core/src/test/scala/org/apache/spark/sql/test/SharedSQLContext.scala 9 additions, 4 deletions...st/scala/org/apache/spark/sql/test/SharedSQLContext.scala
Loading
Please register or sign in to comment