-
- Downloads
[SPARK-5126][Core] Verify Spark urls before creating Actors so that invalid...
[SPARK-5126][Core] Verify Spark urls before creating Actors so that invalid urls can crash the process. Because `actorSelection` will return `deadLetters` for an invalid path, Worker keeps quiet for an invalid master url. It's better to log an error so that people can find such problem quickly. This PR will check the url before sending to `actorSelection`, throw and log a SparkException for an invalid url. Author: zsxwing <zsxwing@gmail.com> Closes #3927 from zsxwing/SPARK-5126 and squashes the following commits: 9d429ee [zsxwing] Create a utility method in Utils to parse Spark url; verify urls before creating Actors so that invalid urls can crash the process. 8286e51 [zsxwing] Check the url before sending to Akka and log the error if the url is invalid
Showing
- core/src/main/scala/org/apache/spark/deploy/Client.scala 2 additions, 0 deletionscore/src/main/scala/org/apache/spark/deploy/Client.scala
- core/src/main/scala/org/apache/spark/deploy/client/AppClient.scala 9 additions, 13 deletions...main/scala/org/apache/spark/deploy/client/AppClient.scala
- core/src/main/scala/org/apache/spark/deploy/master/Master.scala 17 additions, 8 deletions...rc/main/scala/org/apache/spark/deploy/master/Master.scala
- core/src/main/scala/org/apache/spark/deploy/worker/Worker.scala 9 additions, 12 deletions...rc/main/scala/org/apache/spark/deploy/worker/Worker.scala
- core/src/main/scala/org/apache/spark/util/Utils.scala 29 additions, 0 deletionscore/src/main/scala/org/apache/spark/util/Utils.scala
- core/src/test/scala/org/apache/spark/deploy/master/MasterSuite.scala 50 additions, 0 deletions...st/scala/org/apache/spark/deploy/master/MasterSuite.scala
Loading
Please register or sign in to comment