-
- Downloads
[SPARK-17531] Don't initialize Hive Listeners for the Execution Client
## What changes were proposed in this pull request? If a user provides listeners inside the Hive Conf, the configuration for these listeners are passed to the Hive Execution Client as well. This may cause issues for two reasons: 1. The Execution Client will actually generate garbage 2. The listener class needs to be both in the Spark Classpath and Hive Classpath This PR empties the listener configurations in `HiveUtils.newTemporaryConfiguration` so that the execution client will not contain the listener confs, but the metadata client will. ## How was this patch tested? Unit tests Author: Burak Yavuz <brkyvz@gmail.com> Closes #15086 from brkyvz/null-listeners.
Showing
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala 7 additions, 0 deletions.../src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveUtilsSuite.scala 36 additions, 0 deletions...test/scala/org/apache/spark/sql/hive/HiveUtilsSuite.scala
Please register or sign in to comment