-
- Downloads
[SPARK-19695][SQL] Throw an exception if a `columnNameOfCorruptRecord` field...
[SPARK-19695][SQL] Throw an exception if a `columnNameOfCorruptRecord` field violates requirements in json formats ## What changes were proposed in this pull request? This pr comes from #16928 and fixed a json behaviour along with the CSV one. ## How was this patch tested? Added tests in `JsonSuite`. Author: Takeshi Yamamuro <yamamuro@apache.org> Closes #17023 from maropu/SPARK-19695.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JacksonParser.scala 4 additions, 1 deletion...la/org/apache/spark/sql/catalyst/json/JacksonParser.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala 10 additions, 1 deletion...src/main/scala/org/apache/spark/sql/DataFrameReader.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JsonFileFormat.scala 11 additions, 2 deletions...spark/sql/execution/datasources/json/JsonFileFormat.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala 31 additions, 0 deletions...ache/spark/sql/execution/datasources/json/JsonSuite.scala
Loading
Please register or sign in to comment