-
- Downloads
[SPARK-15782][YARN] Set spark.jars system property in client mode
## What changes were proposed in this pull request? When `--packages` is specified with `spark-shell` the classes from those packages cannot be found, which I think is due to some of the changes in `SPARK-12343`. In particular `SPARK-12343` removes a line that sets the `spark.jars` system property in client mode, which is used by the repl main class to set the classpath. ## How was this patch tested? Tested manually. This system property is used by the repl to populate its classpath. If this is not set properly the classes for external packages cannot be found. tgravescs vanzin as you may be familiar with this part of the code. Author: Nezih Yigitbasi <nyigitbasi@netflix.com> Closes #13527 from nezihyigitbasi/repl-fix.
Showing
- core/src/main/scala/org/apache/spark/SparkContext.scala 1 addition, 1 deletioncore/src/main/scala/org/apache/spark/SparkContext.scala
- core/src/main/scala/org/apache/spark/util/Utils.scala 20 additions, 0 deletionscore/src/main/scala/org/apache/spark/util/Utils.scala
- core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala 12 additions, 0 deletions...test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala
- repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkILoop.scala 9 additions, 2 deletions....10/src/main/scala/org/apache/spark/repl/SparkILoop.scala
- repl/scala-2.11/src/main/scala/org/apache/spark/repl/Main.scala 1 addition, 3 deletions...cala-2.11/src/main/scala/org/apache/spark/repl/Main.scala
Loading
Please register or sign in to comment