-
- Downloads
[SPARK-3090] [CORE] Stop SparkContext if user forgets to.
Set up a shutdown hook to try to stop the Spark context in case the user forgets to do it. The main effect is that any open logs files are flushed and closed, which is particularly interesting for event logs. Author: Marcelo Vanzin <vanzin@cloudera.com> Closes #5696 from vanzin/SPARK-3090 and squashes the following commits: 3b554b5 [Marcelo Vanzin] [SPARK-3090] [core] Stop SparkContext if user forgets to.
Showing
- core/src/main/scala/org/apache/spark/SparkContext.scala 25 additions, 13 deletionscore/src/main/scala/org/apache/spark/SparkContext.scala
- core/src/main/scala/org/apache/spark/util/Utils.scala 8 additions, 2 deletionscore/src/main/scala/org/apache/spark/util/Utils.scala
- yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala 2 additions, 8 deletions...cala/org/apache/spark/deploy/yarn/ApplicationMaster.scala
Loading
Please register or sign in to comment