diff --git a/docs/configuration.md b/docs/configuration.md index 1a3eef345c66df70e1db1850bd6c8e9dee3f36a1..22abe1c5a9943f4c477fff24dcb53392e77f19fe 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -331,7 +331,7 @@ Apart from these, the following properties are also available, and may be useful <td>spark.shuffle.consolidateFiles</td> <td>false</td> <td> - If set to "true", consolidates intermediate files created during a shuffle. + If set to "true", consolidates intermediate files created during a shuffle. Creating fewer files can improve filesystem performance if you run shuffles with large numbers of reduce tasks. </td> </tr> <tr> @@ -346,7 +346,7 @@ Apart from these, the following properties are also available, and may be useful <td>spark.speculation.interval</td> <td>100</td> <td> - How often Spark will check for tasks to speculate, in seconds. + How often Spark will check for tasks to speculate, in milliseconds. </td> </tr> <tr>