This folder contains a script, spark-ec2, for launching Spark clusters on Amazon EC2. Usage instructions are available online at: http://spark.apache.org/docs/latest/ec2-scripts.html
Allan Douglas R. de Oliveira
authored
Added option to configure number of worker instances and to set SPARK_MASTER_OPTS Depends on: https://github.com/mesos/spark-ec2/pull/46 Author: Allan Douglas R. de Oliveira <allan@chaordicsystems.com> Closes #612 from douglaz/ec2_configurable_workers and squashes the following commits: d6c5d65 [Allan Douglas R. de Oliveira] Added master opts parameter 6c34671 [Allan Douglas R. de Oliveira] Use number of worker instances as string on template ba528b9 [Allan Douglas R. de Oliveira] Added SPARK_WORKER_INSTANCES parameter
Name | Last commit | Last update |
---|---|---|
.. | ||
deploy.generic/root/spark-ec2 | ||
third_party | ||
README | ||
spark-ec2 | ||
spark_ec2.py |