Skip to content
  • Jeff Zhang's avatar
    f00df40c
    [SPARK-11775][PYSPARK][SQL] Allow PySpark to register Java UDF · f00df40c
    Jeff Zhang authored
    Currently pyspark can only call the builtin java UDF, but can not call custom java UDF. It would be better to allow that. 2 benefits:
    * Leverage the power of rich third party java library
    * Improve the performance. Because if we use python UDF, python daemons will be started on worker which will affect the performance.
    
    Author: Jeff Zhang <zjffdu@apache.org>
    
    Closes #9766 from zjffdu/SPARK-11775.
    f00df40c
    [SPARK-11775][PYSPARK][SQL] Allow PySpark to register Java UDF
    Jeff Zhang authored
    Currently pyspark can only call the builtin java UDF, but can not call custom java UDF. It would be better to allow that. 2 benefits:
    * Leverage the power of rich third party java library
    * Improve the performance. Because if we use python UDF, python daemons will be started on worker which will affect the performance.
    
    Author: Jeff Zhang <zjffdu@apache.org>
    
    Closes #9766 from zjffdu/SPARK-11775.
Loading