-
- Downloads
[SPARK-2993] [MLLib] colStats (wrapper around MultivariateStatisticalSummary) in Statistics
For both Scala and Python. The ser/de util functions were moved out of `PythonMLLibAPI` and into their own object to avoid creating the `PythonMLLibAPI` object inside of `MultivariateStatisticalSummarySerialized`, which is then referenced inside of a method in `PythonMLLibAPI`. `MultivariateStatisticalSummarySerialized` was created to serialize the `Vector` fields in `MultivariateStatisticalSummary`. Author: Doris Xin <doris.s.xin@gmail.com> Closes #1911 from dorx/colStats and squashes the following commits: 77b9924 [Doris Xin] developerAPI tag de9cbbe [Doris Xin] reviewer comments and moved more ser/de 459faba [Doris Xin] colStats in Statistics for both Scala and Python
Showing
- mllib/src/main/scala/org/apache/spark/mllib/api/python/PythonMLLibAPI.scala 285 additions, 247 deletions...la/org/apache/spark/mllib/api/python/PythonMLLibAPI.scala
- mllib/src/main/scala/org/apache/spark/mllib/recommendation/MatrixFactorizationModel.scala 3 additions, 4 deletions...spark/mllib/recommendation/MatrixFactorizationModel.scala
- mllib/src/main/scala/org/apache/spark/mllib/stat/Statistics.scala 13 additions, 0 deletions...c/main/scala/org/apache/spark/mllib/stat/Statistics.scala
- mllib/src/test/scala/org/apache/spark/mllib/api/python/PythonMLLibAPISuite.scala 8 additions, 9 deletions...g/apache/spark/mllib/api/python/PythonMLLibAPISuite.scala
- python/pyspark/mllib/stat.py 65 additions, 1 deletionpython/pyspark/mllib/stat.py
Please register or sign in to comment