From 1450b8ef87d65634800941bbaf259d9b4dd6cc3b Mon Sep 17 00:00:00 2001 From: Patrick Wendell <pwendell@gmail.com> Date: Wed, 4 Dec 2013 18:49:32 -0800 Subject: [PATCH] Small changes from Matei review --- docs/configuration.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/configuration.md b/docs/configuration.md index 1a3eef345c..22abe1c5a9 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -331,7 +331,7 @@ Apart from these, the following properties are also available, and may be useful <td>spark.shuffle.consolidateFiles</td> <td>false</td> <td> - If set to "true", consolidates intermediate files created during a shuffle. + If set to "true", consolidates intermediate files created during a shuffle. Creating fewer files can improve filesystem performance if you run shuffles with large numbers of reduce tasks. </td> </tr> <tr> @@ -346,7 +346,7 @@ Apart from these, the following properties are also available, and may be useful <td>spark.speculation.interval</td> <td>100</td> <td> - How often Spark will check for tasks to speculate, in seconds. + How often Spark will check for tasks to speculate, in milliseconds. </td> </tr> <tr> -- GitLab