Skip to content
Snippets Groups Projects
Commit cc91e218 authored by Luc Bourlier's avatar Luc Bourlier Committed by Reynold Xin
Browse files

[SPARK-12805][MESOS] Fixes documentation on Mesos run modes

The default run has changed, but the documentation didn't fully reflect the change.

Author: Luc Bourlier <luc.bourlier@typesafe.com>

Closes #10740 from skyluc/issue/mesos-modes-doc.
parent 63eee86c
No related branches found
No related tags found
No related merge requests found
...@@ -202,7 +202,7 @@ where each application gets more or fewer machines as it ramps up and down, but ...@@ -202,7 +202,7 @@ where each application gets more or fewer machines as it ramps up and down, but
additional overhead in launching each task. This mode may be inappropriate for low-latency additional overhead in launching each task. This mode may be inappropriate for low-latency
requirements like interactive queries or serving web requests. requirements like interactive queries or serving web requests.
To run in coarse-grained mode, set the `spark.mesos.coarse` property to false in your To run in fine-grained mode, set the `spark.mesos.coarse` property to false in your
[SparkConf](configuration.html#spark-properties): [SparkConf](configuration.html#spark-properties):
{% highlight scala %} {% highlight scala %}
...@@ -266,13 +266,11 @@ See the [configuration page](configuration.html) for information on Spark config ...@@ -266,13 +266,11 @@ See the [configuration page](configuration.html) for information on Spark config
<tr><th>Property Name</th><th>Default</th><th>Meaning</th></tr> <tr><th>Property Name</th><th>Default</th><th>Meaning</th></tr>
<tr> <tr>
<td><code>spark.mesos.coarse</code></td> <td><code>spark.mesos.coarse</code></td>
<td>false</td> <td>true</td>
<td> <td>
If set to <code>true</code>, runs over Mesos clusters in If set to <code>true</code>, runs over Mesos clusters in "coarse-grained" sharing mode, where Spark acquires one long-lived Mesos task on each machine.
<a href="running-on-mesos.html#mesos-run-modes">"coarse-grained" sharing mode</a>, If set to <code>false</code>, runs over Mesos cluster in "fine-grained" sharing mode, where one Mesos task is created per Spark task.
where Spark acquires one long-lived Mesos task on each machine instead of one Mesos task per Detailed information in <a href="running-on-mesos.html#mesos-run-modes">'Mesos Run Modes'</a>.
Spark task. This gives lower-latency scheduling for short queries, but leaves resources in use
for the whole duration of the Spark job.
</td> </td>
</tr> </tr>
<tr> <tr>
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment