-
- Downloads
[SPARK-16336][SQL] Suggest doing table refresh upon FileNotFoundException
## What changes were proposed in this pull request? This patch appends a message to suggest users running refresh table or reloading data frames when Spark sees a FileNotFoundException due to stale, cached metadata. ## How was this patch tested? Added a unit test for this in MetadataCacheSuite. Author: petermaxlee <petermaxlee@gmail.com> Closes #14003 from petermaxlee/SPARK-16336.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala 14 additions, 1 deletion.../apache/spark/sql/execution/datasources/FileScanRDD.scala
- sql/core/src/test/scala/org/apache/spark/sql/MetadataCacheSuite.scala 88 additions, 0 deletions.../test/scala/org/apache/spark/sql/MetadataCacheSuite.scala
Loading
Please register or sign in to comment