Skip to content
Snippets Groups Projects
Commit a642051a authored by root's avatar root
Browse files

Fixed a performance bug in BlockManager that was creating garbage when

returning deserialized, in-memory RDDs.
parent 8feb5caa
No related branches found
No related tags found
No related merge requests found
...@@ -131,7 +131,7 @@ class MemoryStore(blockManager: BlockManager, maxMemory: Long) ...@@ -131,7 +131,7 @@ class MemoryStore(blockManager: BlockManager, maxMemory: Long)
return None return None
} }
if (entry.deserialized) { if (entry.deserialized) {
return Some(entry.value.asInstanceOf[ArrayBuffer[Any]].toIterator) return Some(entry.value.asInstanceOf[ArrayBuffer[Any]].iterator)
} else { } else {
return Some(dataDeserialize(entry.value.asInstanceOf[ByteBuffer].duplicate())) return Some(dataDeserialize(entry.value.asInstanceOf[ByteBuffer].duplicate()))
} }
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment