-
- Downloads
[SPARK-10643][CORE] Make spark-submit download remote files to local in client mode
## What changes were proposed in this pull request? This PR makes spark-submit script download remote files to local file system for local/standalone client mode. ## How was this patch tested? - Unit tests - Manual tests by adding s3a jar and testing against file on s3. Please review http://spark.apache.org/contributing.html before opening a pull request. Author: Yu Peng <loneknightpy@gmail.com> Closes #18078 from loneknightpy/download-jar-in-spark-submit.
Showing
- core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala 47 additions, 1 deletion.../src/main/scala/org/apache/spark/deploy/SparkSubmit.scala
- core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala 93 additions, 2 deletions...test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala
Loading
Please register or sign in to comment