-
- Downloads
[SPARK-2469] Use Snappy (instead of LZF) for default shuffle compression codec
This reduces shuffle compression memory usage by 3x. Author: Reynold Xin <rxin@apache.org> Closes #1415 from rxin/snappy and squashes the following commits: 06c1a01 [Reynold Xin] SPARK-2469: Use Snappy (instead of LZF) for default shuffle compression codec.
Showing
- core/src/main/scala/org/apache/spark/io/CompressionCodec.scala 2 additions, 2 deletions...src/main/scala/org/apache/spark/io/CompressionCodec.scala
- core/src/test/scala/org/apache/spark/io/CompressionCodecSuite.scala 1 addition, 1 deletion...est/scala/org/apache/spark/io/CompressionCodecSuite.scala
Please register or sign in to comment