-
- Downloads
[SPARK-4124] [MLlib] [PySpark] simplify serialization in MLlib Python API
Create several helper functions to call MLlib Java API, convert the arguments to Java type and convert return value to Python object automatically, this simplify serialization in MLlib Python API very much. After this, the MLlib Python API does not need to deal with serialization details anymore, it's easier to add new API. cc mengxr Author: Davies Liu <davies@databricks.com> Closes #2995 from davies/cleanup and squashes the following commits: 8fa6ec6 [Davies Liu] address comments 16b85a0 [Davies Liu] Merge branch 'master' of github.com:apache/spark into cleanup 43743e5 [Davies Liu] bugfix 731331f [Davies Liu] simplify serialization in MLlib Python API
Showing
- mllib/src/main/scala/org/apache/spark/mllib/api/python/PythonMLLibAPI.scala 45 additions, 39 deletions...la/org/apache/spark/mllib/api/python/PythonMLLibAPI.scala
- python/pyspark/mllib/classification.py 12 additions, 18 deletionspython/pyspark/mllib/classification.py
- python/pyspark/mllib/clustering.py 6 additions, 9 deletionspython/pyspark/mllib/clustering.py
- python/pyspark/mllib/common.py 135 additions, 0 deletionspython/pyspark/mllib/common.py
- python/pyspark/mllib/feature.py 20 additions, 102 deletionspython/pyspark/mllib/feature.py
- python/pyspark/mllib/linalg.py 0 additions, 12 deletionspython/pyspark/mllib/linalg.py
- python/pyspark/mllib/random.py 8 additions, 26 deletionspython/pyspark/mllib/random.py
- python/pyspark/mllib/recommendation.py 14 additions, 48 deletionspython/pyspark/mllib/recommendation.py
- python/pyspark/mllib/regression.py 21 additions, 31 deletionspython/pyspark/mllib/regression.py
- python/pyspark/mllib/stat.py 13 additions, 52 deletionspython/pyspark/mllib/stat.py
- python/pyspark/mllib/tree.py 11 additions, 44 deletionspython/pyspark/mllib/tree.py
- python/pyspark/mllib/util.py 2 additions, 5 deletionspython/pyspark/mllib/util.py
Loading
Please register or sign in to comment