Skip to content
Snippets Groups Projects
Commit 58b3aff9 authored by Kay Ousterhout's avatar Kay Ousterhout
Browse files

Fixed problem with scheduler delay

parent fc78f67d
No related branches found
No related tags found
No related merge requests found
......@@ -120,11 +120,14 @@ private[spark] class StagePage(parent: JobProgressUI) {
// machine and to send back the result (but not the time to fetch the task result,
// if it needed to be fetched from the block manager on the worker).
val schedulerDelays = validTasks.map{case (info, metrics, exception) =>
if (info.gettingResultTime > 0) {
(info.gettingResultTime - info.launchTime).toDouble
} else {
(info.finishTime - info.launchTime).toDouble
val totalExecutionTime = {
if (info.gettingResultTime > 0) {
(info.gettingResultTime - info.launchTime).toDouble
} else {
(info.finishTime - info.launchTime).toDouble
}
}
totalExecutionTime - metrics.get.executorRunTime
}
val schedulerDelayQuantiles = ("Scheduler delay" +:
Distribution(schedulerDelays).get.getQuantiles().map(
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment