Skip to content
Snippets Groups Projects
Commit dceedb46 authored by Patrick Wendell's avatar Patrick Wendell
Browse files

Merge pull request #364 from pwendell/fix

Fixing config option "retained_stages" => "retainedStages".

This is a very esoteric option and it's out of sync with the style we use.
So it seems fitting to fix it for 0.9.0.
parents 04d83fc3 112c0a17
No related branches found
No related tags found
No related merge requests found
...@@ -33,7 +33,7 @@ import org.apache.spark.scheduler._ ...@@ -33,7 +33,7 @@ import org.apache.spark.scheduler._
*/ */
private[spark] class JobProgressListener(val sc: SparkContext) extends SparkListener { private[spark] class JobProgressListener(val sc: SparkContext) extends SparkListener {
// How many stages to remember // How many stages to remember
val RETAINED_STAGES = sc.conf.get("spark.ui.retained_stages", "1000").toInt val RETAINED_STAGES = sc.conf.get("spark.ui.retainedStages", "1000").toInt
val DEFAULT_POOL_NAME = "default" val DEFAULT_POOL_NAME = "default"
val stageIdToPool = new HashMap[Int, String]() val stageIdToPool = new HashMap[Int, String]()
......
...@@ -130,7 +130,7 @@ Apart from these, the following properties are also available, and may be useful ...@@ -130,7 +130,7 @@ Apart from these, the following properties are also available, and may be useful
</td> </td>
</tr> </tr>
<tr> <tr>
<td>spark.ui.retained_stages</td> <td>spark.ui.retainedStages</td>
<td>1000</td> <td>1000</td>
<td> <td>
How many stages the Spark UI remembers before garbage collecting. How many stages the Spark UI remembers before garbage collecting.
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment