Skip to content
Snippets Groups Projects
Commit b591de7c authored by Nick Pritchard's avatar Nick Pritchard Committed by Josh Rosen
Browse files

[SPARK-11039][Documentation][Web UI] Document additional ui configurations

Add documentation for configuration:
- spark.sql.ui.retainedExecutions
- spark.streaming.ui.retainedBatches

Author: Nick Pritchard <nicholas.pritchard@falkonry.com>

Closes #9052 from pnpritchard/SPARK-11039.
parent d45a0d3c
No related branches found
No related tags found
No related merge requests found
...@@ -554,6 +554,20 @@ Apart from these, the following properties are also available, and may be useful ...@@ -554,6 +554,20 @@ Apart from these, the following properties are also available, and may be useful
How many finished drivers the Spark UI and status APIs remember before garbage collecting. How many finished drivers the Spark UI and status APIs remember before garbage collecting.
</td> </td>
</tr> </tr>
<tr>
<td><code>spark.sql.ui.retainedExecutions</code></td>
<td>1000</td>
<td>
How many finished executions the Spark UI and status APIs remember before garbage collecting.
</td>
</tr>
<tr>
<td><code>spark.streaming.ui.retainedBatches</code></td>
<td>1000</td>
<td>
How many finished batches the Spark UI and status APIs remember before garbage collecting.
</td>
</tr>
</table> </table>
#### Compression and Serialization #### Compression and Serialization
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment