Skip to content
Snippets Groups Projects
  • Davies Liu's avatar
    1aad8c6e
    [SPARK-16259][PYSPARK] cleanup options in DataFrame read/write API · 1aad8c6e
    Davies Liu authored
    ## What changes were proposed in this pull request?
    
    There are some duplicated code for options in DataFrame reader/writer API, this PR clean them up, it also fix a bug for `escapeQuotes` of csv().
    
    ## How was this patch tested?
    
    Existing tests.
    
    Author: Davies Liu <davies@databricks.com>
    
    Closes #13948 from davies/csv_options.
    1aad8c6e
    History
    [SPARK-16259][PYSPARK] cleanup options in DataFrame read/write API
    Davies Liu authored
    ## What changes were proposed in this pull request?
    
    There are some duplicated code for options in DataFrame reader/writer API, this PR clean them up, it also fix a bug for `escapeQuotes` of csv().
    
    ## How was this patch tested?
    
    Existing tests.
    
    Author: Davies Liu <davies@databricks.com>
    
    Closes #13948 from davies/csv_options.