-
- Downloads
[SPARK-6227][MLLIB][PYSPARK] Implement PySpark wrappers for SVD and PCA (v2)
Add PCA and SVD to PySpark's wrappers for `RowMatrix` and `IndexedRowMatrix` (SVD only). Based on #7963, updated. ## How was this patch tested? New doc tests and unit tests. Ran all examples locally. Author: MechCoder <manojkumarsivaraj334@gmail.com> Author: Nick Pentreath <nickp@za.ibm.com> Closes #17621 from MLnick/SPARK-6227-pyspark-svd-pca.
Showing
- docs/mllib-dimensionality-reduction.md 17 additions, 12 deletionsdocs/mllib-dimensionality-reduction.md
- examples/src/main/java/org/apache/spark/examples/mllib/JavaPCAExample.java 16 additions, 11 deletions.../java/org/apache/spark/examples/mllib/JavaPCAExample.java
- examples/src/main/java/org/apache/spark/examples/mllib/JavaSVDExample.java 14 additions, 13 deletions.../java/org/apache/spark/examples/mllib/JavaSVDExample.java
- examples/src/main/python/mllib/pca_rowmatrix_example.py 46 additions, 0 deletionsexamples/src/main/python/mllib/pca_rowmatrix_example.py
- examples/src/main/python/mllib/svd_example.py 48 additions, 0 deletionsexamples/src/main/python/mllib/svd_example.py
- examples/src/main/scala/org/apache/spark/examples/mllib/PCAOnRowMatrixExample.scala 2 additions, 2 deletions...g/apache/spark/examples/mllib/PCAOnRowMatrixExample.scala
- examples/src/main/scala/org/apache/spark/examples/mllib/SVDExample.scala 7 additions, 4 deletions...in/scala/org/apache/spark/examples/mllib/SVDExample.scala
- python/pyspark/mllib/linalg/distributed.py 195 additions, 4 deletionspython/pyspark/mllib/linalg/distributed.py
- python/pyspark/mllib/tests.py 63 additions, 0 deletionspython/pyspark/mllib/tests.py
Loading
Please register or sign in to comment