Skip to content
Snippets Groups Projects
  • Takeshi YAMAMURO's avatar
    b7e8d1cb
    [SPARK-15585][SQL] Fix NULL handling along with a spark-csv behaivour · b7e8d1cb
    Takeshi YAMAMURO authored
    ## What changes were proposed in this pull request?
    This pr fixes the behaviour of `format("csv").option("quote", null)` along with one of spark-csv.
    Also, it explicitly sets default values for CSV options in python.
    
    ## How was this patch tested?
    Added tests in CSVSuite.
    
    Author: Takeshi YAMAMURO <linguin.m.s@gmail.com>
    
    Closes #13372 from maropu/SPARK-15585.
    b7e8d1cb
    History
    [SPARK-15585][SQL] Fix NULL handling along with a spark-csv behaivour
    Takeshi YAMAMURO authored
    ## What changes were proposed in this pull request?
    This pr fixes the behaviour of `format("csv").option("quote", null)` along with one of spark-csv.
    Also, it explicitly sets default values for CSV options in python.
    
    ## How was this patch tested?
    Added tests in CSVSuite.
    
    Author: Takeshi YAMAMURO <linguin.m.s@gmail.com>
    
    Closes #13372 from maropu/SPARK-15585.