Skip to content
Snippets Groups Projects
Commit ab8177da authored by lewuathe's avatar lewuathe Committed by Josh Rosen
Browse files

[SPARK-4652][DOCS] Add docs about spark-git-repo option

There might be some cases when WIPS spark version need to be run
on EC2 cluster. In order to setup this type of cluster more easily,
add --spark-git-repo option description to ec2 documentation.

Author: lewuathe <lewuathe@me.com>
Author: Josh Rosen <joshrosen@databricks.com>

Closes #3513 from Lewuathe/doc-for-development-spark-cluster and squashes the following commits:

6dae8ee [lewuathe] Wrap consistent with other descriptions
cfaf9be [lewuathe] Add docs about spark-git-repo option

(Editing / cleanup by Josh Rosen)
parent 743a889d
No related branches found
No related tags found
No related merge requests found
......@@ -85,6 +85,11 @@ another.
specified version of Spark. The `<version>` can be a version number
(e.g. "0.7.3") or a specific git hash. By default, a recent
version will be used.
- `--spark-git-repo=<repository url>` will let you run a custom version of
Spark that is built from the given git repository. By default, the
[Apache Github mirror](https://github.com/apache/spark) will be used.
When using a custom Spark version, `--spark-version` must be set to git
commit hash, such as 317e114, instead of a version number.
- If one of your launches fails due to e.g. not having the right
permissions on your private key file, you can run `launch` with the
`--resume` option to restart the setup process on an existing cluster.
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment