-
- Downloads
[SPARK-18750][YARN] Avoid using "mapValues" when allocating containers.
That method is prone to stack overflows when the input map is really large; instead, use plain "map". Also includes a unit test that was tested and caused stack overflows without the fix. Author: Marcelo Vanzin <vanzin@cloudera.com> Closes #16667 from vanzin/SPARK-18750.
Showing
- resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/LocalityPreferredContainerPlacementStrategy.scala 6 additions, 5 deletions...oy/yarn/LocalityPreferredContainerPlacementStrategy.scala
- resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/LocalityPlacementStrategySuite.scala 87 additions, 0 deletions...he/spark/deploy/yarn/LocalityPlacementStrategySuite.scala
Loading
Please register or sign in to comment