-
- Downloads
[SPARK-6046] [core] Reorganize deprecated config support in SparkConf.
This change tries to follow the chosen way for handling deprecated configs in SparkConf: all values (old and new) are kept in the conf object, and newer names take precedence over older ones when retrieving the value. Warnings are logged when config options are set, which generally happens on the driver node (where the logs are most visible). Author: Marcelo Vanzin <vanzin@cloudera.com> Closes #5514 from vanzin/SPARK-6046 and squashes the following commits: 9371529 [Marcelo Vanzin] Avoid math. 6cf3f11 [Marcelo Vanzin] Review feedback. 2445d48 [Marcelo Vanzin] Fix (and cleanup) update interval initialization. b6824be [Marcelo Vanzin] Clean up the other deprecated config use also. ab20351 [Marcelo Vanzin] Update FsHistoryProvider to only retrieve new config key. 2c93209 [Marcelo Vanzin] [SPARK-6046] [core] Reorganize deprecated config support in SparkConf.
Showing
- core/src/main/scala/org/apache/spark/SparkConf.scala 95 additions, 79 deletionscore/src/main/scala/org/apache/spark/SparkConf.scala
- core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala 2 additions, 7 deletions...a/org/apache/spark/deploy/history/FsHistoryProvider.scala
- core/src/main/scala/org/apache/spark/executor/Executor.scala 1 addition, 4 deletionscore/src/main/scala/org/apache/spark/executor/Executor.scala
- core/src/test/scala/org/apache/spark/SparkConfSuite.scala 22 additions, 0 deletionscore/src/test/scala/org/apache/spark/SparkConfSuite.scala
- docs/monitoring.md 3 additions, 3 deletionsdocs/monitoring.md
- yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala 1 addition, 2 deletions.../src/main/scala/org/apache/spark/deploy/yarn/Client.scala
Loading
Please register or sign in to comment