-
- Downloads
[SPARK-15405][YARN] Remove unnecessary upload of config archive.
We only need one copy of it. The client code that was uploading the second copy just needs to be modified to update the metadata in the cache, so that the AM knows where to find the configuration. Tested by running app on YARN and verifying in the logs only one archive is uploaded. Author: Marcelo Vanzin <vanzin@cloudera.com> Closes #13232 from vanzin/SPARK-15405.
Showing
- yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala 5 additions, 4 deletions.../src/main/scala/org/apache/spark/deploy/yarn/Client.scala
- yarn/src/test/scala/org/apache/spark/deploy/yarn/ClientSuite.scala 8 additions, 4 deletions...test/scala/org/apache/spark/deploy/yarn/ClientSuite.scala
Loading
Please register or sign in to comment