-
- Downloads
Merge pull request #247 from aarondav/minor
Increase spark.akka.askTimeout default to 30 seconds In experimental clusters we've observed that a 10 second timeout was insufficient, despite having a low number of nodes and relatively small workload (16 nodes, <1.5 TB data). This would cause an entire job to fail at the beginning of the reduce phase. There is no particular reason for this value to be small as a timeout should only occur in an exceptional situation. Also centralized the reading of spark.akka.askTimeout to AkkaUtils (surely this can later be cleaned up to use Typesafe). Finally, deleted some lurking implicits. If anyone can think of a reason they should still be there, please let me know.
No related branches found
No related tags found
Showing
- core/src/main/scala/org/apache/spark/MapOutputTracker.scala 2 additions, 3 deletionscore/src/main/scala/org/apache/spark/MapOutputTracker.scala
- core/src/main/scala/org/apache/spark/deploy/client/Client.scala 3 additions, 3 deletions...rc/main/scala/org/apache/spark/deploy/client/Client.scala
- core/src/main/scala/org/apache/spark/deploy/master/Master.scala 6 additions, 11 deletions...rc/main/scala/org/apache/spark/deploy/master/Master.scala
- core/src/main/scala/org/apache/spark/deploy/master/ui/ApplicationPage.scala 5 additions, 9 deletions...a/org/apache/spark/deploy/master/ui/ApplicationPage.scala
- core/src/main/scala/org/apache/spark/deploy/master/ui/IndexPage.scala 6 additions, 10 deletions...n/scala/org/apache/spark/deploy/master/ui/IndexPage.scala
- core/src/main/scala/org/apache/spark/deploy/master/ui/MasterWebUI.scala 3 additions, 7 deletions...scala/org/apache/spark/deploy/master/ui/MasterWebUI.scala
- core/src/main/scala/org/apache/spark/deploy/worker/ui/IndexPage.scala 2 additions, 2 deletions...n/scala/org/apache/spark/deploy/worker/ui/IndexPage.scala
- core/src/main/scala/org/apache/spark/deploy/worker/ui/WorkerWebUI.scala 3 additions, 7 deletions...scala/org/apache/spark/deploy/worker/ui/WorkerWebUI.scala
- core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala 4 additions, 6 deletions...ark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
- core/src/main/scala/org/apache/spark/storage/BlockManagerMaster.scala 4 additions, 3 deletions...n/scala/org/apache/spark/storage/BlockManagerMaster.scala
- core/src/main/scala/org/apache/spark/storage/BlockManagerMasterActor.scala 4 additions, 7 deletions...la/org/apache/spark/storage/BlockManagerMasterActor.scala
- core/src/main/scala/org/apache/spark/ui/storage/BlockManagerUI.scala 0 additions, 3 deletions...in/scala/org/apache/spark/ui/storage/BlockManagerUI.scala
- core/src/main/scala/org/apache/spark/util/AkkaUtils.scala 6 additions, 0 deletionscore/src/main/scala/org/apache/spark/util/AkkaUtils.scala
Loading
Please register or sign in to comment