Skip to content
Snippets Groups Projects
Commit 99de4b8f authored by Andrew Ash's avatar Andrew Ash Committed by Wenchen Fan
Browse files

[SPARK-21953] Show both memory and disk bytes spilled if either is present


As written now, there must be both memory and disk bytes spilled to show either of them. If there is only one of those types of spill recorded, it will be hidden.

Author: Andrew Ash <andrew@andrewash.com>

Closes #19164 from ash211/patch-3.

(cherry picked from commit 6308c65f)
Signed-off-by: default avatarWenchen Fan <wenchen@databricks.com>
parent 3ae7ab8e
No related branches found
No related tags found
No related merge requests found
......@@ -104,7 +104,7 @@ private[spark] object UIData {
def hasOutput: Boolean = outputBytes > 0
def hasShuffleRead: Boolean = shuffleReadTotalBytes > 0
def hasShuffleWrite: Boolean = shuffleWriteBytes > 0
def hasBytesSpilled: Boolean = memoryBytesSpilled > 0 && diskBytesSpilled > 0
def hasBytesSpilled: Boolean = memoryBytesSpilled > 0 || diskBytesSpilled > 0
}
/**
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment