Skip to content
Snippets Groups Projects
Commit b1d59e60 authored by Sean Owen's avatar Sean Owen
Browse files

[SPARK-21593][DOCS] Fix 2 rendering errors on configuration page

## What changes were proposed in this pull request?

Fix 2 rendering errors on configuration doc page, due to SPARK-21243 and SPARK-15355.

## How was this patch tested?

Manually built and viewed docs with jekyll

Author: Sean Owen <sowen@cloudera.com>

Closes #18793 from srowen/SPARK-21593.
parent 74cda94c
No related branches found
No related tags found
No related merge requests found
...@@ -536,15 +536,17 @@ Apart from these, the following properties are also available, and may be useful ...@@ -536,15 +536,17 @@ Apart from these, the following properties are also available, and may be useful
</td> </td>
</tr> </tr>
<tr> <tr>
<td><code>spark.reducer.maxBlocksInFlightPerAddress</code></td> <td><code>spark.reducer.maxBlocksInFlightPerAddress</code></td>
<td>Int.MaxValue</td> <td>Int.MaxValue</td>
<td> <td>
This configuration limits the number of remote blocks being fetched per reduce task from a This configuration limits the number of remote blocks being fetched per reduce task from a
given host port. When a large number of blocks are being requested from a given address in a given host port. When a large number of blocks are being requested from a given address in a
single fetch or simultaneously, this could crash the serving executor or Node Manager. This single fetch or simultaneously, this could crash the serving executor or Node Manager. This
is especially useful to reduce the load on the Node Manager when external shuffle is enabled. is especially useful to reduce the load on the Node Manager when external shuffle is enabled.
You can mitigate this issue by setting it to a lower value. You can mitigate this issue by setting it to a lower value.
</td> </td>
</tr>
<tr>
<td><code>spark.reducer.maxReqSizeShuffleToMem</code></td> <td><code>spark.reducer.maxReqSizeShuffleToMem</code></td>
<td>Long.MaxValue</td> <td>Long.MaxValue</td>
<td> <td>
...@@ -1081,7 +1083,7 @@ Apart from these, the following properties are also available, and may be useful ...@@ -1081,7 +1083,7 @@ Apart from these, the following properties are also available, and may be useful
</td> </td>
</tr> </tr>
<tr> <tr>
<td><code>spark.storage.replication.proactive<code></td> <td><code>spark.storage.replication.proactive</code></td>
<td>false</td> <td>false</td>
<td> <td>
Enables proactive block replication for RDD blocks. Cached RDD block replicas lost due to Enables proactive block replication for RDD blocks. Cached RDD block replicas lost due to
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment