-
- Downloads
[SPARK-16505][YARN] Optionally propagate error during shuffle service startup.
This prevents the NM from starting when something is wrong, which would lead to later errors which are confusing and harder to debug. Added a unit test to verify startup fails if something is wrong. Author: Marcelo Vanzin <vanzin@cloudera.com> Closes #14162 from vanzin/SPARK-16505.
Showing
- common/network-yarn/src/main/java/org/apache/spark/network/yarn/YarnShuffleService.java 43 additions, 32 deletions...ava/org/apache/spark/network/yarn/YarnShuffleService.java
- docs/job-scheduling.md 1 addition, 12 deletionsdocs/job-scheduling.md
- docs/running-on-yarn.md 31 additions, 0 deletionsdocs/running-on-yarn.md
- yarn/src/test/scala/org/apache/spark/network/yarn/YarnShuffleServiceSuite.scala 31 additions, 3 deletions...g/apache/spark/network/yarn/YarnShuffleServiceSuite.scala
Loading
Please register or sign in to comment