-
- Downloads
[SPARK-19817][SS] Make it clear that `timeZone` is a general option in DataStreamReader/Writer
## What changes were proposed in this pull request? As timezone setting can also affect partition values, it works for all formats, we should make it clear. ## How was this patch tested? N/A Author: Liwei Lin <lwlin7@gmail.com> Closes #17299 from lw-lin/timezone.
Showing
- python/pyspark/sql/readwriter.py 4 additions, 4 deletionspython/pyspark/sql/readwriter.py
- python/pyspark/sql/streaming.py 24 additions, 8 deletionspython/pyspark/sql/streaming.py
- sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala 3 additions, 3 deletions...src/main/scala/org/apache/spark/sql/DataFrameReader.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala 3 additions, 3 deletions...src/main/scala/org/apache/spark/sql/DataFrameWriter.scala
- sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala 18 additions, 4 deletions...ala/org/apache/spark/sql/streaming/DataStreamReader.scala
- sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamWriter.scala 18 additions, 0 deletions...ala/org/apache/spark/sql/streaming/DataStreamWriter.scala
Loading
Please register or sign in to comment