-
- Downloads
[SPARK-12549][SQL] Take Option[Seq[DataType]] in UDF input type specification.
In Spark we allow UDFs to declare its expected input types in order to apply type coercion. The expected input type parameter takes a Seq[DataType] and uses Nil when no type coercion is applied. It makes more sense to take Option[Seq[DataType]] instead, so we can differentiate a no-arg function vs function with no expected input type specified. Author: Reynold Xin <rxin@databricks.com> Closes #10504 from rxin/SPARK-12549.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala 8 additions, 4 deletions.../org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala
- sql/core/src/main/scala/org/apache/spark/sql/UDFRegistration.scala 48 additions, 48 deletions...src/main/scala/org/apache/spark/sql/UDFRegistration.scala
- sql/core/src/main/scala/org/apache/spark/sql/UserDefinedFunction.scala 2 additions, 2 deletions...main/scala/org/apache/spark/sql/UserDefinedFunction.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/WriterContainer.scala 4 additions, 1 deletion...che/spark/sql/execution/datasources/WriterContainer.scala
- sql/core/src/main/scala/org/apache/spark/sql/functions.scala 13 additions, 13 deletionssql/core/src/main/scala/org/apache/spark/sql/functions.scala
Loading
Please register or sign in to comment