Skip to content
Snippets Groups Projects
  • Davies Liu's avatar
    8fb1d1c7
    [SPARK-15357] Cooperative spilling should check consumer memory mode · 8fb1d1c7
    Davies Liu authored
    ## What changes were proposed in this pull request?
    
    Since we support forced spilling for Spillable, which only works in OnHeap mode, different from other SQL operators (could be OnHeap or OffHeap), we should considering the mode of consumer before calling trigger forced spilling.
    
    ## How was this patch tested?
    
    Add new test.
    
    Author: Davies Liu <davies@databricks.com>
    
    Closes #13151 from davies/fix_mode.
    8fb1d1c7
    History
    [SPARK-15357] Cooperative spilling should check consumer memory mode
    Davies Liu authored
    ## What changes were proposed in this pull request?
    
    Since we support forced spilling for Spillable, which only works in OnHeap mode, different from other SQL operators (could be OnHeap or OffHeap), we should considering the mode of consumer before calling trigger forced spilling.
    
    ## How was this patch tested?
    
    Add new test.
    
    Author: Davies Liu <davies@databricks.com>
    
    Closes #13151 from davies/fix_mode.
MimaExcludes.scala 119.29 KiB