From b591de7c07ba8e71092f71e34001520bec995a8a Mon Sep 17 00:00:00 2001 From: Nick Pritchard <nicholas.pritchard@falkonry.com> Date: Thu, 15 Oct 2015 12:45:37 -0700 Subject: [PATCH] [SPARK-11039][Documentation][Web UI] Document additional ui configurations Add documentation for configuration: - spark.sql.ui.retainedExecutions - spark.streaming.ui.retainedBatches Author: Nick Pritchard <nicholas.pritchard@falkonry.com> Closes #9052 from pnpritchard/SPARK-11039. --- docs/configuration.md | 14 ++++++++++++++ 1 file changed, 14 insertions(+) diff --git a/docs/configuration.md b/docs/configuration.md index 771d93be04..46d92ceb76 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -554,6 +554,20 @@ Apart from these, the following properties are also available, and may be useful How many finished drivers the Spark UI and status APIs remember before garbage collecting. </td> </tr> +<tr> + <td><code>spark.sql.ui.retainedExecutions</code></td> + <td>1000</td> + <td> + How many finished executions the Spark UI and status APIs remember before garbage collecting. + </td> +</tr> +<tr> + <td><code>spark.streaming.ui.retainedBatches</code></td> + <td>1000</td> + <td> + How many finished batches the Spark UI and status APIs remember before garbage collecting. + </td> +</tr> </table> #### Compression and Serialization -- GitLab