Skip to content
Snippets Groups Projects
Commit 07367533 authored by Eric Liang's avatar Eric Liang Committed by Reynold Xin
Browse files

[SPARK-16025][CORE] Document OFF_HEAP storage level in 2.0

This has changed from 1.6, and now stores memory off-heap using spark's off-heap support instead of in tachyon.

Author: Eric Liang <ekl@databricks.com>

Closes #13744 from ericl/spark-16025.
parent 4f7f1c43
No related branches found
No related tags found
No related merge requests found
......@@ -1220,6 +1220,11 @@ storage levels is:
<td> MEMORY_ONLY_2, MEMORY_AND_DISK_2, etc. </td>
<td> Same as the levels above, but replicate each partition on two cluster nodes. </td>
</tr>
<tr>
<td> OFF_HEAP (experimental) </td>
<td> Similar to MEMORY_ONLY_SER, but store the data in
<a href="configuration.html#memory-management">off-heap memory</a>. This requires off-heap memory to be enabled. </td>
</tr>
</table>
**Note:** *In Python, stored objects will always be serialized with the [Pickle](https://docs.python.org/2/library/pickle.html) library,
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment