From 13cab5ba44e2f8d2d2204b3b0d39d7c23a819bdb Mon Sep 17 00:00:00 2001
From: nartz <nartzpod@gmail.com>
Date: Thu, 9 Oct 2014 00:02:11 -0700
Subject: [PATCH] add spark.driver.memory to config docs
It took me a minute to track this down, so I thought it could be useful to have it in the docs.
I'm unsure if 512mb is the default for spark.driver.memory? Also - there could be a better value for the 'description' to differentiate it from spark.executor.memory.
Author: nartz <nartzpod@gmail.com>
Author: Nathan Artz <nathanartz@Nathans-MacBook-Pro.local>
Closes #2410 from nartz/docs/add-spark-driver-memory-to-config-docs and squashes the following commits:
a2f6c62 [nartz] Update configuration.md
74521b8 [Nathan Artz] add spark.driver.memory to config docs
---
docs/configuration.md | 8 ++++++++
1 file changed, 8 insertions(+)
diff --git a/docs/configuration.md b/docs/configuration.md
index 1c33855365..f311f0d2a6 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -103,6 +103,14 @@ of the most common options to set are:
(e.g. <code>512m</code>, <code>2g</code>).
</td>
</tr>
+<tr>
+ <td><code>spark.driver.memory</code></td>
+ <td>512m</td>
+ <td>
+ Amount of memory to use for the driver process, i.e. where SparkContext is initialized.
+ (e.g. <code>512m</code>, <code>2g</code>).
+ </td>
+</tr>
<tr>
<td><code>spark.serializer</code></td>
<td>org.apache.spark.serializer.<br />JavaSerializer</td>
--
GitLab