From c6469a02f14e8c23e9b4e1336768f8bbfc15f5d8 Mon Sep 17 00:00:00 2001 From: scwf <wangfei1@huawei.com> Date: Thu, 2 Oct 2014 13:47:30 -0700 Subject: [PATCH] [SPARK-3766][Doc]Snappy is also the default compress codec for broadcast variables Author: scwf <wangfei1@huawei.com> Closes #2632 from scwf/compress-doc and squashes the following commits: 7983a1a [scwf] snappy is the default compression codec for broadcast --- docs/configuration.md | 9 +++++---- 1 file changed, 5 insertions(+), 4 deletions(-) diff --git a/docs/configuration.md b/docs/configuration.md index 791b6f2aa3..316490f0f4 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -413,10 +413,11 @@ Apart from these, the following properties are also available, and may be useful <td><code>spark.io.compression.codec</code></td> <td>snappy</td> <td> - The codec used to compress internal data such as RDD partitions and shuffle outputs. By default, - Spark provides three codecs: <code>lz4</code>, <code>lzf</code>, and <code>snappy</code>. You - can also use fully qualified class names to specify the codec, e.g. - <code>org.apache.spark.io.LZ4CompressionCodec</code>, + The codec used to compress internal data such as RDD partitions, broadcast variables and + shuffle outputs. By default, Spark provides three codecs: <code>lz4</code>, <code>lzf</code>, + and <code>snappy</code>. You can also use fully qualified class names to specify the codec, + e.g. + <code>org.apache.spark.io.LZ4CompressionCodec</code>, <code>org.apache.spark.io.LZFCompressionCodec</code>, and <code>org.apache.spark.io.SnappyCompressionCodec</code>. </td> -- GitLab