Skip to content
Snippets Groups Projects
Commit 8a0aa81c authored by KaiXinXiaoLei's avatar KaiXinXiaoLei Committed by Andrew Or
Browse files

[CORE] The descriptionof jobHistory config should be spark.history.fs.logDirectory

The config option  is spark.history.fs.logDirectory, not spark.fs.history.logDirectory. So the descriptionof  should be changed. Thanks.

Author: KaiXinXiaoLei <huleilei1@huawei.com>

Closes #5332 from KaiXinXiaoLei/historyConfig and squashes the following commits:

5ffbfb5 [KaiXinXiaoLei] the describe of jobHistory config is error
parent 4b82bd73
No related branches found
No related tags found
No related merge requests found
......@@ -118,7 +118,7 @@ private[history] class FsHistoryProvider(conf: SparkConf) extends ApplicationHis
if (!fs.exists(path)) {
var msg = s"Log directory specified does not exist: $logDir."
if (logDir == DEFAULT_LOG_DIR) {
msg += " Did you configure the correct one through spark.fs.history.logDirectory?"
msg += " Did you configure the correct one through spark.history.fs.logDirectory?"
}
throw new IllegalArgumentException(msg)
}
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment