-
- Downloads
[SPARK-1507][YARN]specify # cores for ApplicationMaster
Based on top of changes in https://github.com/apache/spark/pull/3806. https://issues.apache.org/jira/browse/SPARK-1507 `--driver-cores` and `spark.driver.cores` for all cluster modes and `spark.yarn.am.cores` for yarn client mode. Author: WangTaoTheTonic <barneystinson@aliyun.com> Author: WangTao <barneystinson@aliyun.com> Closes #4018 from WangTaoTheTonic/SPARK-1507 and squashes the following commits: 01419d3 [WangTaoTheTonic] amend the args name b255795 [WangTaoTheTonic] indet thing d86557c [WangTaoTheTonic] some comments amend 43c9392 [WangTao] fix compile error b39a100 [WangTao] specify # cores for ApplicationMaster
Showing
- core/src/main/scala/org/apache/spark/deploy/ClientArguments.scala 3 additions, 3 deletions.../main/scala/org/apache/spark/deploy/ClientArguments.scala
- core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala 1 addition, 0 deletions.../src/main/scala/org/apache/spark/deploy/SparkSubmit.scala
- core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala 5 additions, 0 deletions.../scala/org/apache/spark/deploy/SparkSubmitArguments.scala
- docs/configuration.md 11 additions, 4 deletionsdocs/configuration.md
- docs/running-on-yarn.md 17 additions, 0 deletionsdocs/running-on-yarn.md
- yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala 1 addition, 0 deletions.../src/main/scala/org/apache/spark/deploy/yarn/Client.scala
- yarn/src/main/scala/org/apache/spark/deploy/yarn/ClientArguments.scala 20 additions, 4 deletions.../scala/org/apache/spark/deploy/yarn/ClientArguments.scala
Loading
Please register or sign in to comment