Skip to content
Snippets Groups Projects
Commit b603e55a authored by Reynold Xin's avatar Reynold Xin
Browse files

Changed block storage level for shuffle to DISK_ONLY.

parent 2d761e33
No related branches found
No related tags found
No related merge requests found
......@@ -188,7 +188,7 @@ class ShuffleMapTask(
// Get a scala iterator from java map
val iter: Iterator[(Any, Any)] = bucketIterators(i)
// TODO: This should probably be DISK_ONLY
blockManager.put(blockId, iter, StorageLevel.MEMORY_ONLY, false)
blockManager.put(blockId, iter, StorageLevel.DISK_ONLY, false)
}
return SparkEnv.get.blockManager.blockManagerId
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment