-
- Downloads
[SPARK-20367] Properly unescape column names of partitioning columns parsed from paths.
## What changes were proposed in this pull request? When infering partitioning schema from paths, the column in parsePartitionColumn should be unescaped with unescapePathName, just like it is being done in e.g. parsePathFragmentAsSeq. ## How was this patch tested? Added a test to FileIndexSuite. Author: Juliusz Sompolski <julek@databricks.com> Closes #17703 from juliuszsompolski/SPARK-20367.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/PartitioningUtils.scala 1 addition, 1 deletion...e/spark/sql/execution/datasources/PartitioningUtils.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileIndexSuite.scala 12 additions, 0 deletions...ache/spark/sql/execution/datasources/FileIndexSuite.scala
Please register or sign in to comment