-
- Downloads
[SPARK-20887][CORE] support alternative keys in ConfigBuilder
## What changes were proposed in this pull request? `ConfigBuilder` builds `ConfigEntry` which can only read value with one key, if we wanna change the config name but still keep the old one, it's hard to do. This PR introduce `ConfigBuilder.withAlternative`, to support reading config value with alternative keys. And also rename `spark.scheduler.listenerbus.eventqueue.size` to `spark.scheduler.listenerbus.eventqueue.capacity` with this feature, according to https://github.com/apache/spark/pull/14269#discussion_r118432313 ## How was this patch tested? a new test Author: Wenchen Fan <wenchen@databricks.com> Closes #18110 from cloud-fan/config.
Showing
- core/src/main/scala/org/apache/spark/SparkConf.scala 2 additions, 0 deletionscore/src/main/scala/org/apache/spark/SparkConf.scala
- core/src/main/scala/org/apache/spark/internal/config/ConfigBuilder.scala 15 additions, 9 deletions...cala/org/apache/spark/internal/config/ConfigBuilder.scala
- core/src/main/scala/org/apache/spark/internal/config/ConfigEntry.scala 22 additions, 14 deletions.../scala/org/apache/spark/internal/config/ConfigEntry.scala
- core/src/main/scala/org/apache/spark/internal/config/ConfigProvider.scala 2 additions, 14 deletions...ala/org/apache/spark/internal/config/ConfigProvider.scala
- core/src/main/scala/org/apache/spark/internal/config/ConfigReader.scala 17 additions, 1 deletion...scala/org/apache/spark/internal/config/ConfigReader.scala
- core/src/main/scala/org/apache/spark/internal/config/package.scala 4 additions, 2 deletions...main/scala/org/apache/spark/internal/config/package.scala
- core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala 3 additions, 12 deletions...in/scala/org/apache/spark/scheduler/LiveListenerBus.scala
- core/src/test/scala/org/apache/spark/internal/config/ConfigEntrySuite.scala 27 additions, 0 deletions...a/org/apache/spark/internal/config/ConfigEntrySuite.scala
Loading
Please register or sign in to comment