Skip to content
  • Bryan Cutler's avatar
    57d70d26
    [SPARK-17161][PYSPARK][ML] Add PySpark-ML JavaWrapper convenience function to... · 57d70d26
    Bryan Cutler authored
    [SPARK-17161][PYSPARK][ML] Add PySpark-ML JavaWrapper convenience function to create Py4J JavaArrays
    
    ## What changes were proposed in this pull request?
    
    Adding convenience function to Python `JavaWrapper` so that it is easy to create a Py4J JavaArray that is compatible with current class constructors that have a Scala `Array` as input so that it is not necessary to have a Java/Python friendly constructor.  The function takes a Java class as input that is used by Py4J to create the Java array of the given class.  As an example, `OneVsRest` has been updated to use this and the alternate constructor is removed.
    
    ## How was this patch tested?
    
    Added unit tests for the new convenience function and updated `OneVsRest` doctests which use this to persist the model.
    
    Author: Bryan Cutler <cutlerb@gmail.com>
    
    Closes #14725 from BryanCutler/pyspark-new_java_array-CountVectorizer-SPARK-17161.
    57d70d26
    [SPARK-17161][PYSPARK][ML] Add PySpark-ML JavaWrapper convenience function to...
    Bryan Cutler authored
    [SPARK-17161][PYSPARK][ML] Add PySpark-ML JavaWrapper convenience function to create Py4J JavaArrays
    
    ## What changes were proposed in this pull request?
    
    Adding convenience function to Python `JavaWrapper` so that it is easy to create a Py4J JavaArray that is compatible with current class constructors that have a Scala `Array` as input so that it is not necessary to have a Java/Python friendly constructor.  The function takes a Java class as input that is used by Py4J to create the Java array of the given class.  As an example, `OneVsRest` has been updated to use this and the alternate constructor is removed.
    
    ## How was this patch tested?
    
    Added unit tests for the new convenience function and updated `OneVsRest` doctests which use this to persist the model.
    
    Author: Bryan Cutler <cutlerb@gmail.com>
    
    Closes #14725 from BryanCutler/pyspark-new_java_array-CountVectorizer-SPARK-17161.
Loading