-
- Downloads
Merge pull request #366 from colorant/yarn-dev
More yarn code refactor Try to retrive common code in yarn alpha/stable for client and workerRunnable to reduce duplicated codes. By put them into a trait in common dir and extends with them. Same works could be done for the remaining files in alpha/stable , while the remainning files have much more overlapping codes with different API call here and there within functions, and will need much more close review , aslo it might divide functions into too small trifle ones, thus might not deserve to be done in this way. So just make it run for these two files firstly.
No related branches found
No related tags found
Showing
- yarn/alpha/src/main/scala/org/apache/spark/deploy/yarn/Client.scala 20 additions, 351 deletions.../src/main/scala/org/apache/spark/deploy/yarn/Client.scala
- yarn/alpha/src/main/scala/org/apache/spark/deploy/yarn/WorkerRunnable.scala 4 additions, 122 deletions...n/scala/org/apache/spark/deploy/yarn/WorkerRunnable.scala
- yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ClientBase.scala 410 additions, 0 deletions.../main/scala/org/apache/spark/deploy/yarn/ClientBase.scala
- yarn/common/src/main/scala/org/apache/spark/deploy/yarn/WorkerRunnableUtil.scala 176 additions, 0 deletions...ala/org/apache/spark/deploy/yarn/WorkerRunnableUtil.scala
- yarn/stable/src/main/scala/org/apache/spark/deploy/yarn/Client.scala 12 additions, 353 deletions.../src/main/scala/org/apache/spark/deploy/yarn/Client.scala
- yarn/stable/src/main/scala/org/apache/spark/deploy/yarn/WorkerRunnable.scala 5 additions, 125 deletions...n/scala/org/apache/spark/deploy/yarn/WorkerRunnable.scala
Loading
Please register or sign in to comment