-
- Downloads
[SPARK-1522] : YARN ClientBase throws a NPE if there is no YARN Application CP
The current implementation of ClientBase.getDefaultYarnApplicationClasspath inspects the MRJobConfig class for the field DEFAULT_YARN_APPLICATION_CLASSPATH when it should be really looking into YarnConfiguration. If the Application Configuration has no yarn.application.classpath defined a NPE exception will be thrown. Additional Changes include: * Test Suite for ClientBase added [ticket: SPARK-1522] : https://issues.apache.org/jira/browse/SPARK-1522 Author : bernardo.gomezpalacio@gmail.com Testing : SPARK_HADOOP_VERSION=2.3.0 SPARK_YARN=true ./sbt/sbt test Author: Bernardo Gomez Palacio <bernardo.gomezpalacio@gmail.com> Closes #433 from berngp/feature/SPARK-1522 and squashes the following commits: 2c2e118 [Bernardo Gomez Palacio] [SPARK-1522]: YARN ClientBase throws a NPE if there is no YARN Application specific CP
Showing
- yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ClientBase.scala 55 additions, 34 deletions.../main/scala/org/apache/spark/deploy/yarn/ClientBase.scala
- yarn/common/src/test/scala/org/apache/spark/deploy/yarn/ClientBaseSuite.scala 112 additions, 0 deletions.../scala/org/apache/spark/deploy/yarn/ClientBaseSuite.scala
Loading
Please register or sign in to comment