-
- Downloads
[SPARK-6048] SparkConf should not translate deprecated configs on set
There are multiple issues with translating on set outlined in the JIRA. This PR reverts the translation logic added to `SparkConf`. In the future, after the 1.3.0 release we will figure out a way to reorganize the internal structure more elegantly. For now, let's preserve the existing semantics of `SparkConf` since it's a public interface. Unfortunately this means duplicating some code for now, but this is all internal and we can always clean it up later. Author: Andrew Or <andrew@databricks.com> Closes #4799 from andrewor14/conf-set-translate and squashes the following commits: 11c525b [Andrew Or] Move warning to driver 10e77b5 [Andrew Or] Add documentation for deprecation precedence a369cb1 [Andrew Or] Merge branch 'master' of github.com:apache/spark into conf-set-translate c26a9e3 [Andrew Or] Revert all translate logic in SparkConf fef6c9c [Andrew Or] Restore deprecation logic for spark.executor.userClassPathFirst 94b4dfa [Andrew Or] Translate on get, not set
Showing
- core/src/main/scala/org/apache/spark/SparkConf.scala 11 additions, 4 deletionscore/src/main/scala/org/apache/spark/SparkConf.scala
- core/src/main/scala/org/apache/spark/executor/Executor.scala 9 additions, 4 deletionscore/src/main/scala/org/apache/spark/executor/Executor.scala
- core/src/test/scala/org/apache/spark/SparkConfSuite.scala 0 additions, 12 deletionscore/src/test/scala/org/apache/spark/SparkConfSuite.scala
- docs/configuration.md 3 additions, 1 deletiondocs/configuration.md
- yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala 2 additions, 1 deletion.../src/main/scala/org/apache/spark/deploy/yarn/Client.scala
Loading
Please register or sign in to comment