Skip to content
Snippets Groups Projects
Commit 14fa87bd authored by meiyoula's avatar meiyoula Committed by Thomas Graves
Browse files

[SPARK-4966][YARN]The MemoryOverhead value is setted not correctly

Author: meiyoula <1039320815@qq.com>

Closes #3797 from XuTingjun/MemoryOverhead and squashes the following commits:

5a780fc [meiyoula] Update ClientArguments.scala
parent a3e51cc9
No related branches found
No related tags found
No related merge requests found
......@@ -39,6 +39,8 @@ private[spark] class ClientArguments(args: Array[String], sparkConf: SparkConf)
var appName: String = "Spark"
var priority = 0
parseArgs(args.toList)
// Additional memory to allocate to containers
// For now, use driver's memory overhead as our AM container's memory overhead
val amMemoryOverhead = sparkConf.getInt("spark.yarn.driver.memoryOverhead",
......@@ -50,7 +52,6 @@ private[spark] class ClientArguments(args: Array[String], sparkConf: SparkConf)
private val isDynamicAllocationEnabled =
sparkConf.getBoolean("spark.dynamicAllocation.enabled", false)
parseArgs(args.toList)
loadEnvironmentArgs()
validateArgs()
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment