Skip to content
  • Holden Karau's avatar
    00288ea2
    [SPARK-13687][PYTHON] Cleanup PySpark parallelize temporary files · 00288ea2
    Holden Karau authored
    ## What changes were proposed in this pull request?
    
    Eagerly cleanup PySpark's temporary parallelize cleanup files rather than waiting for shut down.
    
    ## How was this patch tested?
    
    Unit tests
    
    Author: Holden Karau <holden@us.ibm.com>
    
    Closes #12233 from holdenk/SPARK-13687-cleanup-pyspark-temporary-files.
    00288ea2
    [SPARK-13687][PYTHON] Cleanup PySpark parallelize temporary files
    Holden Karau authored
    ## What changes were proposed in this pull request?
    
    Eagerly cleanup PySpark's temporary parallelize cleanup files rather than waiting for shut down.
    
    ## How was this patch tested?
    
    Unit tests
    
    Author: Holden Karau <holden@us.ibm.com>
    
    Closes #12233 from holdenk/SPARK-13687-cleanup-pyspark-temporary-files.
Loading