-
- Downloads
[SPARK-19991][CORE][YARN] FileSegmentManagedBuffer performance improvement
## What changes were proposed in this pull request? Avoid `NoSuchElementException` every time `ConfigProvider.get(val, default)` falls back to default. This apparently causes non-trivial overhead in at least one path, and can easily be avoided. See https://github.com/apache/spark/pull/17329 ## How was this patch tested? Existing tests Author: Sean Owen <sowen@cloudera.com> Closes #17567 from srowen/SPARK-19991.
Showing
- common/network-common/src/main/java/org/apache/spark/network/util/MapConfigProvider.java 6 additions, 0 deletions...java/org/apache/spark/network/util/MapConfigProvider.java
- common/network-yarn/src/main/java/org/apache/spark/network/yarn/util/HadoopConfigProvider.java 6 additions, 0 deletions.../apache/spark/network/yarn/util/HadoopConfigProvider.java
- core/src/main/scala/org/apache/spark/network/netty/SparkTransportConf.scala 1 addition, 1 deletion...a/org/apache/spark/network/netty/SparkTransportConf.scala
Please register or sign in to comment