Skip to content
Snippets Groups Projects
Commit def7c265 authored by Jagadeesan's avatar Jagadeesan Committed by Sean Owen
Browse files

[SPARK-17449][DOCUMENTATION] Relation between heartbeatInterval and…

## What changes were proposed in this pull request?

The relation between spark.network.timeout and spark.executor.heartbeatInterval should be mentioned in the document.

… network timeout]

Author: Jagadeesan <as2@us.ibm.com>

Closes #15042 from jagadeesanas2/SPARK-17449.
parent a454a4d8
No related branches found
No related tags found
No related merge requests found
...@@ -32,6 +32,7 @@ import org.apache.spark.util._ ...@@ -32,6 +32,7 @@ import org.apache.spark.util._
* A heartbeat from executors to the driver. This is a shared message used by several internal * A heartbeat from executors to the driver. This is a shared message used by several internal
* components to convey liveness or execution information for in-progress tasks. It will also * components to convey liveness or execution information for in-progress tasks. It will also
* expire the hosts that have not heartbeated for more than spark.network.timeout. * expire the hosts that have not heartbeated for more than spark.network.timeout.
* spark.executor.heartbeatInterval should be significantly less than spark.network.timeout.
*/ */
private[spark] case class Heartbeat( private[spark] case class Heartbeat(
executorId: String, executorId: String,
......
...@@ -987,7 +987,8 @@ Apart from these, the following properties are also available, and may be useful ...@@ -987,7 +987,8 @@ Apart from these, the following properties are also available, and may be useful
<td>10s</td> <td>10s</td>
<td>Interval between each executor's heartbeats to the driver. Heartbeats let <td>Interval between each executor's heartbeats to the driver. Heartbeats let
the driver know that the executor is still alive and update it with metrics for in-progress the driver know that the executor is still alive and update it with metrics for in-progress
tasks.</td> tasks. spark.executor.heartbeatInterval should be significantly less than
spark.network.timeout</td>
</tr> </tr>
<tr> <tr>
<td><code>spark.files.fetchTimeout</code></td> <td><code>spark.files.fetchTimeout</code></td>
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment