Skip to content
Snippets Groups Projects
  • Nick Lavers's avatar
    0019005a
    [SPARK-19219][SQL] Fix Parquet log output defaults · 0019005a
    Nick Lavers authored
    ## What changes were proposed in this pull request?
    
    Changing the default parquet logging levels to reflect the changes made in PR [#15538](https://github.com/apache/spark/pull/15538), in order to prevent the flood of log messages by default.
    
    ## How was this patch tested?
    
    Default log output when reading from parquet 1.6 files was compared with and without this change. The change eliminates the extraneous logging and makes the output readable.
    
    Author: Nick Lavers <nick.lavers@videoamp.com>
    
    Closes #16580 from nicklavers/spark-19219-set_default_parquet_log_level.
    [SPARK-19219][SQL] Fix Parquet log output defaults
    Nick Lavers authored
    ## What changes were proposed in this pull request?
    
    Changing the default parquet logging levels to reflect the changes made in PR [#15538](https://github.com/apache/spark/pull/15538), in order to prevent the flood of log messages by default.
    
    ## How was this patch tested?
    
    Default log output when reading from parquet 1.6 files was compared with and without this change. The change eliminates the extraneous logging and makes the output readable.
    
    Author: Nick Lavers <nick.lavers@videoamp.com>
    
    Closes #16580 from nicklavers/spark-19219-set_default_parquet_log_level.