Skip to content
Snippets Groups Projects
  • Liang-Chi Hsieh's avatar
    baa3e633
    [SPARK-15364][ML][PYSPARK] Implement PySpark picklers for ml.Vector and... · baa3e633
    Liang-Chi Hsieh authored
    [SPARK-15364][ML][PYSPARK] Implement PySpark picklers for ml.Vector and ml.Matrix under spark.ml.python
    
    ## What changes were proposed in this pull request?
    
    Now we have PySpark picklers for new and old vector/matrix, individually. However, they are all implemented under `PythonMLlibAPI`. To separate spark.mllib from spark.ml, we should implement the picklers of new vector/matrix under `spark.ml.python` instead.
    
    ## How was this patch tested?
    Existing tests.
    
    Author: Liang-Chi Hsieh <simonh@tw.ibm.com>
    
    Closes #13219 from viirya/pyspark-pickler-ml.
    baa3e633
    History
    [SPARK-15364][ML][PYSPARK] Implement PySpark picklers for ml.Vector and...
    Liang-Chi Hsieh authored
    [SPARK-15364][ML][PYSPARK] Implement PySpark picklers for ml.Vector and ml.Matrix under spark.ml.python
    
    ## What changes were proposed in this pull request?
    
    Now we have PySpark picklers for new and old vector/matrix, individually. However, they are all implemented under `PythonMLlibAPI`. To separate spark.mllib from spark.ml, we should implement the picklers of new vector/matrix under `spark.ml.python` instead.
    
    ## How was this patch tested?
    Existing tests.
    
    Author: Liang-Chi Hsieh <simonh@tw.ibm.com>
    
    Closes #13219 from viirya/pyspark-pickler-ml.