-
- Downloads
[SPARK-18080][ML][PYTHON] Python API & Examples for Locality Sensitive Hashing
## What changes were proposed in this pull request? This pull request includes python API and examples for LSH. The API changes was based on yanboliang 's PR #15768 and resolved conflicts and API changes on the Scala API. The examples are consistent with Scala examples of MinHashLSH and BucketedRandomProjectionLSH. ## How was this patch tested? API and examples are tested using spark-submit: `bin/spark-submit examples/src/main/python/ml/min_hash_lsh.py` `bin/spark-submit examples/src/main/python/ml/bucketed_random_projection_lsh.py` User guide changes are generated and manually inspected: `SKIP_API=1 jekyll build` Author: Yun Ni <yunn@uber.com> Author: Yanbo Liang <ybliang8@gmail.com> Author: Yunni <Euler57721@gmail.com> Closes #16715 from Yunni/spark-18080.
Showing
- docs/ml-features.md 17 additions, 0 deletionsdocs/ml-features.md
- examples/src/main/java/org/apache/spark/examples/ml/JavaBucketedRandomProjectionLSHExample.java 25 additions, 13 deletions...k/examples/ml/JavaBucketedRandomProjectionLSHExample.java
- examples/src/main/java/org/apache/spark/examples/ml/JavaMinHashLSHExample.java 49 additions, 8 deletions...a/org/apache/spark/examples/ml/JavaMinHashLSHExample.java
- examples/src/main/python/ml/bucketed_random_projection_lsh_example.py 81 additions, 0 deletions.../main/python/ml/bucketed_random_projection_lsh_example.py
- examples/src/main/python/ml/min_hash_lsh_example.py 81 additions, 0 deletionsexamples/src/main/python/ml/min_hash_lsh_example.py
- examples/src/main/scala/org/apache/spark/examples/ml/BucketedRandomProjectionLSHExample.scala 25 additions, 14 deletions...park/examples/ml/BucketedRandomProjectionLSHExample.scala
- examples/src/main/scala/org/apache/spark/examples/ml/MinHashLSHExample.scala 28 additions, 15 deletions...cala/org/apache/spark/examples/ml/MinHashLSHExample.scala
- mllib/src/main/scala/org/apache/spark/ml/feature/LSH.scala 4 additions, 3 deletionsmllib/src/main/scala/org/apache/spark/ml/feature/LSH.scala
- python/pyspark/ml/feature.py 291 additions, 0 deletionspython/pyspark/ml/feature.py
Loading
Please register or sign in to comment