-
- Downloads
[SPARK-5274][SQL] Reconcile Java and Scala UDFRegistration.
As part of SPARK-5193:
1. Removed UDFRegistration as a mixin in SQLContext and made it a field ("udf").
2. For Java UDFs, renamed dataType to returnType.
3. For Scala UDFs, added type tags.
4. Added all Java UDF registration methods to Scala's UDFRegistration.
5. Documentation
Author: Reynold Xin <rxin@databricks.com>
Closes #4056 from rxin/udf-registration and squashes the following commits:
ae9c556 [Reynold Xin] Updated example.
675a3c9 [Reynold Xin] Style fix
47c24ff [Reynold Xin] Python fix.
5f00c45 [Reynold Xin] Restore data type position in java udf and added typetags.
032f006 [Reynold Xin] [SPARK-5193][SQL] Reconcile Java and Scala UDFRegistration.
Showing
- python/pyspark/sql.py 8 additions, 8 deletionspython/pyspark/sql.py
- sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala 28 additions, 1 deletion...core/src/main/scala/org/apache/spark/sql/SQLContext.scala
- sql/core/src/main/scala/org/apache/spark/sql/UdfRegistration.scala 631 additions, 61 deletions...src/main/scala/org/apache/spark/sql/UdfRegistration.scala
- sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala 1 addition, 1 deletion...e/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/UDFSuite.scala 4 additions, 5 deletionssql/core/src/test/scala/org/apache/spark/sql/UDFSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/UserDefinedTypeSuite.scala 1 addition, 1 deletion...est/scala/org/apache/spark/sql/UserDefinedTypeSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveUdfSuite.scala 1 addition, 1 deletion...la/org/apache/spark/sql/hive/execution/HiveUdfSuite.scala
Loading
Please register or sign in to comment