-
- Downloads
[SPARK-21756][SQL] Add JSON option to allow unquoted control characters
## What changes were proposed in this pull request? This patch adds allowUnquotedControlChars option in JSON data source to allow JSON Strings to contain unquoted control characters (ASCII characters with value less than 32, including tab and line feed characters) ## How was this patch tested? Add new test cases Author: vinodkc <vinod.kc.in@gmail.com> Closes #19008 from vinodkc/br_fix_SPARK-21756.
Showing
- python/pyspark/sql/readwriter.py 6 additions, 2 deletionspython/pyspark/sql/readwriter.py
- python/pyspark/sql/streaming.py 6 additions, 2 deletionspython/pyspark/sql/streaming.py
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala 3 additions, 0 deletions...cala/org/apache/spark/sql/catalyst/json/JSONOptions.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala 3 additions, 0 deletions...src/main/scala/org/apache/spark/sql/DataFrameReader.scala
- sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala 3 additions, 0 deletions...ala/org/apache/spark/sql/streaming/DataStreamReader.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonParsingOptionsSuite.scala 15 additions, 0 deletions.../execution/datasources/json/JsonParsingOptionsSuite.scala
Loading
Please register or sign in to comment