-
- Downloads
[SPARK-6081] Support fetching http/https uris in driver runner.
Currently if passed uris such as http/https, it won't able to fetch them as it only calls HadoopFs get. This fix utilizes the existing util method to fetch remote uris as well. Author: Timothy Chen <tnachen@gmail.com> Closes #4832 from tnachen/driver_remote and squashes the following commits: aa52cd6 [Timothy Chen] Support fetching remote uris in driver runner.
Showing
- core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala 13 additions, 8 deletions...n/scala/org/apache/spark/deploy/worker/DriverRunner.scala
- core/src/main/scala/org/apache/spark/deploy/worker/Worker.scala 2 additions, 1 deletion...rc/main/scala/org/apache/spark/deploy/worker/Worker.scala
- core/src/test/scala/org/apache/spark/deploy/JsonProtocolSuite.scala 4 additions, 3 deletions...est/scala/org/apache/spark/deploy/JsonProtocolSuite.scala
- core/src/test/scala/org/apache/spark/deploy/worker/DriverRunnerTest.scala 4 additions, 3 deletions...ala/org/apache/spark/deploy/worker/DriverRunnerTest.scala
Loading
Please register or sign in to comment