Skip to content
Snippets Groups Projects
Unverified Commit 70ffff21 authored by Bill Chambers's avatar Bill Chambers Committed by Sean Owen
Browse files

[DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed

## What changes were proposed in this pull request?

This PR clarifies where accumulators will be displayed.

## How was this patch tested?

No testing.

Please review http://spark.apache.org/contributing.html before opening a pull request.

Author: Bill Chambers <bill@databricks.com>
Author: anabranch <wac.chambers@gmail.com>
Author: Bill Chambers <wchambers@ischool.berkeley.edu>

Closes #16180 from anabranch/improve-acc-docs.
parent 83a42897
No related branches found
No related tags found
No related merge requests found
......@@ -1345,14 +1345,15 @@ therefore be efficiently supported in parallel. They can be used to implement co
MapReduce) or sums. Spark natively supports accumulators of numeric types, and programmers
can add support for new types.
If accumulators are created with a name, they will be
displayed in Spark's UI. This can be useful for understanding the progress of
running stages (NOTE: this is not yet supported in Python).
As a user, you can create named or unnamed accumulators. As seen in the image below, a named accumulator (in this instance `counter`) will display in the web UI for the stage that modifies that accumulator. Spark displays the value for each accumulator modified by a task in the "Tasks" table.
<p style="text-align: center;">
<img src="img/spark-webui-accumulators.png" title="Accumulators in the Spark UI" alt="Accumulators in the Spark UI" />
</p>
Tracking accumulators in the UI can be useful for understanding the progress of
running stages (NOTE: this is not yet supported in Python).
<div class="codetabs">
<div data-lang="scala" markdown="1">
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment