Skip to content
Snippets Groups Projects
Commit 6c1dbd6f authored by Shixiong Zhu's avatar Shixiong Zhu
Browse files

[SPARK-20843][CORE] Add a config to set driver terminate timeout

## What changes were proposed in this pull request?

Add a `worker` configuration to set how long to wait before forcibly killing driver.

## How was this patch tested?

Jenkins

Author: Shixiong Zhu <shixiong@databricks.com>

Closes #18126 from zsxwing/SPARK-20843.
parent a0f8a072
No related branches found
No related tags found
No related merge requests found
...@@ -57,7 +57,8 @@ private[deploy] class DriverRunner( ...@@ -57,7 +57,8 @@ private[deploy] class DriverRunner(
@volatile private[worker] var finalException: Option[Exception] = None @volatile private[worker] var finalException: Option[Exception] = None
// Timeout to wait for when trying to terminate a driver. // Timeout to wait for when trying to terminate a driver.
private val DRIVER_TERMINATE_TIMEOUT_MS = 10 * 1000 private val DRIVER_TERMINATE_TIMEOUT_MS =
conf.getTimeAsMs("spark.worker.driverTerminateTimeout", "10s")
// Decoupled for testing // Decoupled for testing
def setClock(_clock: Clock): Unit = { def setClock(_clock: Clock): Unit = {
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment