Skip to content
Snippets Groups Projects
  • Matei Zaharia's avatar
    666d93c2
    Update Maven build to create assemblies expected by new scripts · 666d93c2
    Matei Zaharia authored
    This includes the following changes:
    - The "assembly" package now builds in Maven by default, and creates an
      assembly containing both hadoop-client and Spark, unlike the old
      BigTop distribution assembly that skipped hadoop-client
    - There is now a bigtop-dist package to build the old BigTop assembly
    - The repl-bin package is no longer built by default since the scripts
      don't reply on it; instead it can be enabled with -Prepl-bin
    - Py4J is now included in the assembly/lib folder as a local Maven repo,
      so that the Maven package can link to it
    - run-example now adds the original Spark classpath as well because the
      Maven examples assembly lists spark-core and such as provided
    - The various Maven projects add a spark-yarn dependency correctly
    666d93c2
    History
    Update Maven build to create assemblies expected by new scripts
    Matei Zaharia authored
    This includes the following changes:
    - The "assembly" package now builds in Maven by default, and creates an
      assembly containing both hadoop-client and Spark, unlike the old
      BigTop distribution assembly that skipped hadoop-client
    - There is now a bigtop-dist package to build the old BigTop assembly
    - The repl-bin package is no longer built by default since the scripts
      don't reply on it; instead it can be enabled with -Prepl-bin
    - Py4J is now included in the assembly/lib folder as a local Maven repo,
      so that the Maven package can link to it
    - run-example now adds the original Spark classpath as well because the
      Maven examples assembly lists spark-core and such as provided
    - The various Maven projects add a spark-yarn dependency correctly