Skip to content
Snippets Groups Projects
Commit 024178c5 authored by Michael Armbrust's avatar Michael Armbrust Committed by Patrick Wendell
Browse files

[HOTFIX][SQL] Remove cleaning of UDFs

It is not safe to run the closure cleaner on slaves.  #2153 introduced this which broke all UDF execution on slaves.  Will re-add cleaning of UDF closures in a follow-up PR.

Author: Michael Armbrust <michael@databricks.com>

Closes #2174 from marmbrus/fixUdfs and squashes the following commits:

55406de [Michael Armbrust] [HOTFIX] Remove cleaning of UDFs
parent dafe3434
No related branches found
No related tags found
No related merge requests found
...@@ -23,9 +23,6 @@ import org.apache.spark.util.ClosureCleaner ...@@ -23,9 +23,6 @@ import org.apache.spark.util.ClosureCleaner
case class ScalaUdf(function: AnyRef, dataType: DataType, children: Seq[Expression]) case class ScalaUdf(function: AnyRef, dataType: DataType, children: Seq[Expression])
extends Expression { extends Expression {
// Clean function when not called with default no-arg constructor.
if (function != null) { ClosureCleaner.clean(function) }
type EvaluatedType = Any type EvaluatedType = Any
def nullable = true def nullable = true
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment