-
- Downloads
[SPARK-19459][SQL][BRANCH-2.1] Support for nested char/varchar fields in ORC
## What changes were proposed in this pull request? This is a backport of the two following commits: https://github.com/apache/spark/commit/78eae7e67fd5dec0c2d5b18000053ce86cd0f1ae & https://github.com/apache/spark/commit/de8a03e68202647555e30fffba551f65bc77608d This PR adds support for ORC tables with (nested) char/varchar fields. ## How was this patch tested? Added a regression test to `OrcSourceSuite`. Author: Herman van Hovell <hvanhovell@databricks.com> Closes #17041 from hvanhovell/SPARK-19459-branch-2.1.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala 32 additions, 8 deletions...ala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/types/HiveStringType.scala 73 additions, 0 deletions...ain/scala/org/apache/spark/sql/types/HiveStringType.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/types/package.scala 9 additions, 1 deletion...t/src/main/scala/org/apache/spark/sql/types/package.scala
- sql/core/src/test/scala/org/apache/spark/sql/sources/TableScanSuite.scala 5 additions, 2 deletions...t/scala/org/apache/spark/sql/sources/TableScanSuite.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala 0 additions, 8 deletions.../src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/MetastoreRelation.scala 3 additions, 4 deletions...n/scala/org/apache/spark/sql/hive/MetastoreRelation.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala 4 additions, 4 deletions...ala/org/apache/spark/sql/hive/client/HiveClientImpl.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/OrcSourceSuite.scala 35 additions, 4 deletions.../scala/org/apache/spark/sql/hive/orc/OrcSourceSuite.scala
Loading
Please register or sign in to comment