-
- Downloads
[SPARK-20009][SQL] Support DDL strings for defining schema in functions.from_json
## What changes were proposed in this pull request? This pr added `StructType.fromDDL` to convert a DDL format string into `StructType` for defining schemas in `functions.from_json`. ## How was this patch tested? Added tests in `JsonFunctionsSuite`. Author: Takeshi Yamamuro <yamamuro@apache.org> Closes #17406 from maropu/SPARK-20009.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/types/StructType.scala 6 additions, 0 deletions...rc/main/scala/org/apache/spark/sql/types/StructType.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/types/DataTypeSuite.scala 64 additions, 21 deletions...test/scala/org/apache/spark/sql/types/DataTypeSuite.scala
- sql/core/src/main/scala/org/apache/spark/sql/functions.scala 12 additions, 3 deletionssql/core/src/main/scala/org/apache/spark/sql/functions.scala
- sql/core/src/test/scala/org/apache/spark/sql/JsonFunctionsSuite.scala 7 additions, 0 deletions.../test/scala/org/apache/spark/sql/JsonFunctionsSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/sources/SimpleTextRelation.scala 1 addition, 1 deletion...ala/org/apache/spark/sql/sources/SimpleTextRelation.scala
Loading
Please register or sign in to comment