[SPARK-13578][CORE] Modify launch scripts to not use assemblies.
Instead of looking for a specially-named assembly, the scripts now will blindly add all jars under the libs directory to the classpath. This libs directory is still currently the old assembly dir, so things should keep working the same way as before until we make more packaging changes. The only lost feature is the detection of multiple assemblies; I consider that a minor nicety that only really affects few developers, so it's probably ok. Tested locally by running spark-shell; also did some minor Win32 testing (just made sure spark-shell started). Author: Marcelo Vanzin <vanzin@cloudera.com> Closes #11591 from vanzin/SPARK-13578.
Showing
- bin/spark-class 7 additions, 22 deletionsbin/spark-class
- bin/spark-class2.cmd 6 additions, 12 deletionsbin/spark-class2.cmd
- launcher/src/main/java/org/apache/spark/launcher/AbstractCommandBuilder.java 18 additions, 30 deletions...ava/org/apache/spark/launcher/AbstractCommandBuilder.java
- launcher/src/main/java/org/apache/spark/launcher/CommandBuilderUtils.java 0 additions, 1 deletion...n/java/org/apache/spark/launcher/CommandBuilderUtils.java
- launcher/src/test/java/org/apache/spark/launcher/SparkSubmitCommandBuilderSuite.java 0 additions, 1 deletion...apache/spark/launcher/SparkSubmitCommandBuilderSuite.java
Loading
Please register or sign in to comment