Skip to content
Snippets Groups Projects
  • Marcelo Vanzin's avatar
    45f8053b
    [SPARK-13578][CORE] Modify launch scripts to not use assemblies. · 45f8053b
    Marcelo Vanzin authored
    Instead of looking for a specially-named assembly, the scripts now will
    blindly add all jars under the libs directory to the classpath. This
    libs directory is still currently the old assembly dir, so things should
    keep working the same way as before until we make more packaging changes.
    
    The only lost feature is the detection of multiple assemblies; I consider
    that a minor nicety that only really affects few developers, so it's probably
    ok.
    
    Tested locally by running spark-shell; also did some minor Win32 testing
    (just made sure spark-shell started).
    
    Author: Marcelo Vanzin <vanzin@cloudera.com>
    
    Closes #11591 from vanzin/SPARK-13578.
    45f8053b
    History
    [SPARK-13578][CORE] Modify launch scripts to not use assemblies.
    Marcelo Vanzin authored
    Instead of looking for a specially-named assembly, the scripts now will
    blindly add all jars under the libs directory to the classpath. This
    libs directory is still currently the old assembly dir, so things should
    keep working the same way as before until we make more packaging changes.
    
    The only lost feature is the detection of multiple assemblies; I consider
    that a minor nicety that only really affects few developers, so it's probably
    ok.
    
    Tested locally by running spark-shell; also did some minor Win32 testing
    (just made sure spark-shell started).
    
    Author: Marcelo Vanzin <vanzin@cloudera.com>
    
    Closes #11591 from vanzin/SPARK-13578.