Skip to content
Snippets Groups Projects
Commit 4576d80a authored by Reynold Xin's avatar Reynold Xin
Browse files

[SPARK-2469] Use Snappy (instead of LZF) for default shuffle compression codec 

This reduces shuffle compression memory usage by 3x.

Author: Reynold Xin <rxin@apache.org>

Closes #1415 from rxin/snappy and squashes the following commits:

06c1a01 [Reynold Xin] SPARK-2469: Use Snappy (instead of LZF) for default shuffle compression codec.
parent c2048a51
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment