diff --git a/docs/configuration.md b/docs/configuration.md index f3bfd036f416470bb07da6f1ad3839f66276b30b..a3029837ff0cdd7516a40b30e4a8db3e9ceada55 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -96,7 +96,13 @@ Apart from these, the following properties are also available, and may be useful <tr><th>Property Name</th><th>Default</th><th>Meaning</th></tr> <tr> <td>spark.default.parallelism</td> - <td>8</td> + <td> + <ul> + <li>Mesos fine grained mode: 8</li> + <li>Local mode: core number of the local machine</li> + <li>Others: total core number of all executor nodes or 2, whichever is larger</li> + </ul> + </td> <td> Default number of tasks to use across the cluster for distributed shuffle operations (<code>groupByKey</code>, <code>reduceByKey</code>, etc) when not set by user.