-
- Downloads
[SPARK-20668][SQL] Modify ScalaUDF to handle nullability.
## What changes were proposed in this pull request? When registering Scala UDF, we can know if the udf will return nullable value or not. `ScalaUDF` and related classes should handle the nullability. ## How was this patch tested? Existing tests. Author: Takuya UESHIN <ueshin@databricks.com> Closes #17911 from ueshin/issues/SPARK-20668.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala 1 addition, 1 deletion...ala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala 3 additions, 3 deletions.../org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala
- sql/core/src/main/scala/org/apache/spark/sql/UDFRegistration.scala 72 additions, 72 deletions...src/main/scala/org/apache/spark/sql/UDFRegistration.scala
- sql/core/src/main/scala/org/apache/spark/sql/expressions/UserDefinedFunction.scala 36 additions, 1 deletion...rg/apache/spark/sql/expressions/UserDefinedFunction.scala
- sql/core/src/main/scala/org/apache/spark/sql/functions.scala 25 additions, 12 deletionssql/core/src/main/scala/org/apache/spark/sql/functions.scala
Loading
Please register or sign in to comment