-
- Downloads
[SPARK-11249][LAUNCHER] Throw error if app resource is not provided.
Without this, the code would build an invalid spark-submit command line, and a more cryptic error would be presented to the user. Also, expose a constant that allows users to set a dummy resource in cases where they don't need an actual resource file; for backwards compatibility, that uses the same "spark-internal" resource that Spark itself uses. Tested via unit tests, run-example, spark-shell, and running the thrift server with mixed spark and hive command line arguments. Author: Marcelo Vanzin <vanzin@cloudera.com> Closes #12909 from vanzin/SPARK-11249.
Showing
- core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala 3 additions, 6 deletions.../src/main/scala/org/apache/spark/deploy/SparkSubmit.scala
- core/src/test/java/org/apache/spark/launcher/SparkLauncherSuite.java 1 addition, 1 deletion...st/java/org/apache/spark/launcher/SparkLauncherSuite.java
- core/src/test/scala/org/apache/spark/launcher/LauncherBackendSuite.scala 1 addition, 1 deletion...cala/org/apache/spark/launcher/LauncherBackendSuite.scala
- launcher/src/main/java/org/apache/spark/launcher/SparkLauncher.java 7 additions, 0 deletions...rc/main/java/org/apache/spark/launcher/SparkLauncher.java
- launcher/src/main/java/org/apache/spark/launcher/SparkSubmitCommandBuilder.java 16 additions, 13 deletions.../org/apache/spark/launcher/SparkSubmitCommandBuilder.java
- launcher/src/test/java/org/apache/spark/launcher/SparkSubmitCommandBuilderSuite.java 9 additions, 2 deletions...apache/spark/launcher/SparkSubmitCommandBuilderSuite.java
- yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnClusterSuite.scala 1 addition, 1 deletion...scala/org/apache/spark/deploy/yarn/YarnClusterSuite.scala
Loading
Please register or sign in to comment