-
- Downloads
[SPARK-10558][CORE] Fix wrong executor state in Master
`ExecutorAdded` can only be sent to `AppClient` when worker report back the executor state as `LOADING`, otherwise because of concurrency issue, `AppClient` will possibly receive `ExectuorAdded` at first, then `ExecutorStateUpdated` with `LOADING` state. Also Master will change the executor state from `LAUNCHING` to `RUNNING` (`AppClient` report back the state as `RUNNING`), then to `LOADING` (worker report back to state as `LOADING`), it should be `LAUNCHING` -> `LOADING` -> `RUNNING`. Also it is wrongly shown in master UI, the state of executor should be `RUNNING` rather than `LOADING`:  Author: jerryshao <sshao@hortonworks.com> Closes #8714 from jerryshao/SPARK-10558.
Showing
- core/src/main/scala/org/apache/spark/deploy/ExecutorState.scala 1 addition, 1 deletion...rc/main/scala/org/apache/spark/deploy/ExecutorState.scala
- core/src/main/scala/org/apache/spark/deploy/client/AppClient.scala 0 additions, 3 deletions...main/scala/org/apache/spark/deploy/client/AppClient.scala
- core/src/main/scala/org/apache/spark/deploy/master/Master.scala 11 additions, 3 deletions...rc/main/scala/org/apache/spark/deploy/master/Master.scala
- core/src/main/scala/org/apache/spark/deploy/worker/Worker.scala 1 addition, 1 deletion...rc/main/scala/org/apache/spark/deploy/worker/Worker.scala
Loading
Please register or sign in to comment