-
- Downloads
Fix race conditions during recovery
One major change was the use of messages instead of raw functions as the parameter of Akka scheduled timers. Since messages are serialized, unlike raw functions, the behavior is easier to think about and doesn't cause race conditions when exceptions are thrown. Another change is to avoid using global pointers that might change without a lock.
Showing
- core/src/main/scala/org/apache/spark/deploy/DeployMessage.scala 6 additions, 1 deletion...rc/main/scala/org/apache/spark/deploy/DeployMessage.scala
- core/src/main/scala/org/apache/spark/deploy/JsonProtocol.scala 2 additions, 1 deletion...src/main/scala/org/apache/spark/deploy/JsonProtocol.scala
- core/src/main/scala/org/apache/spark/deploy/client/Client.scala 21 additions, 8 deletions...rc/main/scala/org/apache/spark/deploy/client/Client.scala
- core/src/main/scala/org/apache/spark/deploy/master/Master.scala 21 additions, 8 deletions...rc/main/scala/org/apache/spark/deploy/master/Master.scala
- core/src/main/scala/org/apache/spark/deploy/master/MasterMessages.scala 2 additions, 0 deletions...scala/org/apache/spark/deploy/master/MasterMessages.scala
- core/src/main/scala/org/apache/spark/deploy/master/ZooKeeperLeaderElectionAgent.scala 32 additions, 19 deletions...he/spark/deploy/master/ZooKeeperLeaderElectionAgent.scala
- core/src/main/scala/org/apache/spark/deploy/worker/Worker.scala 35 additions, 13 deletions...rc/main/scala/org/apache/spark/deploy/worker/Worker.scala
- core/src/test/scala/org/apache/spark/deploy/JsonProtocolSuite.scala 3 additions, 2 deletions...est/scala/org/apache/spark/deploy/JsonProtocolSuite.scala
Loading
Please register or sign in to comment