-
- Downloads
[SPARK-13955][YARN] Also look for Spark jars in the build directory.
Move the logic to find Spark jars to CommandBuilderUtils and make it available for YARN code, so that it's possible to easily launch Spark on YARN from a build directory. Tested by running SparkPi from the build directory on YARN. Author: Marcelo Vanzin <vanzin@cloudera.com> Closes #11970 from vanzin/SPARK-13955.
Showing
- launcher/src/main/java/org/apache/spark/launcher/AbstractCommandBuilder.java 1 addition, 22 deletions...ava/org/apache/spark/launcher/AbstractCommandBuilder.java
- launcher/src/main/java/org/apache/spark/launcher/CommandBuilderUtils.java 25 additions, 0 deletions...n/java/org/apache/spark/launcher/CommandBuilderUtils.java
- yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala 5 additions, 6 deletions.../src/main/scala/org/apache/spark/deploy/yarn/Client.scala
- yarn/src/main/scala/org/apache/spark/launcher/YarnCommandBuilderUtils.scala 9 additions, 0 deletions...a/org/apache/spark/launcher/YarnCommandBuilderUtils.scala
- yarn/src/test/scala/org/apache/spark/deploy/yarn/ClientSuite.scala 2 additions, 1 deletion...test/scala/org/apache/spark/deploy/yarn/ClientSuite.scala
Loading
Please register or sign in to comment