Skip to content
Snippets Groups Projects
Commit 180714a2 authored by skeirik2's avatar skeirik2
Browse files

added an extra condition for dropping blocks in evictBlocksToFreeSpace to ensure correctness

parent 154163ed
No related branches found
No related tags found
No related merge requests found
...@@ -478,7 +478,8 @@ private[spark] class MemoryStore( ...@@ -478,7 +478,8 @@ private[spark] class MemoryStore(
blockInfoManager.blockManager.stageExInfos.get(blockManager.currentStage) match { blockInfoManager.blockManager.stageExInfos.get(blockManager.currentStage) match {
case Some(curStageExInfo) => case Some(curStageExInfo) =>
// cur is this stage's output RDD // cur is this stage's output RDD
if (!curStageExInfo.curRunningRddMap.contains(bxi.blockId.asRDDId.get.rddId)) { if (blockInfoManager.lockForWriting(bxi.blockId, blocking = false).isDefined &&
!curStageExInfo.curRunningRddMap.contains(bxi.blockId.asRDDId.get.rddId)) {
selectedBlocks += bxi.blockId selectedBlocks += bxi.blockId
freedMemory += bxi.size freedMemory += bxi.size
} }
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment