Skip to content
Snippets Groups Projects
  • Yun Ni's avatar
    08c1972a
    [SPARK-18080][ML][PYTHON] Python API & Examples for Locality Sensitive Hashing · 08c1972a
    Yun Ni authored
    ## What changes were proposed in this pull request?
    This pull request includes python API and examples for LSH. The API changes was based on yanboliang 's PR #15768 and resolved conflicts and API changes on the Scala API. The examples are consistent with Scala examples of MinHashLSH and BucketedRandomProjectionLSH.
    
    ## How was this patch tested?
    API and examples are tested using spark-submit:
    `bin/spark-submit examples/src/main/python/ml/min_hash_lsh.py`
    `bin/spark-submit examples/src/main/python/ml/bucketed_random_projection_lsh.py`
    
    User guide changes are generated and manually inspected:
    `SKIP_API=1 jekyll build`
    
    Author: Yun Ni <yunn@uber.com>
    Author: Yanbo Liang <ybliang8@gmail.com>
    Author: Yunni <Euler57721@gmail.com>
    
    Closes #16715 from Yunni/spark-18080.
    08c1972a
    History
    [SPARK-18080][ML][PYTHON] Python API & Examples for Locality Sensitive Hashing
    Yun Ni authored
    ## What changes were proposed in this pull request?
    This pull request includes python API and examples for LSH. The API changes was based on yanboliang 's PR #15768 and resolved conflicts and API changes on the Scala API. The examples are consistent with Scala examples of MinHashLSH and BucketedRandomProjectionLSH.
    
    ## How was this patch tested?
    API and examples are tested using spark-submit:
    `bin/spark-submit examples/src/main/python/ml/min_hash_lsh.py`
    `bin/spark-submit examples/src/main/python/ml/bucketed_random_projection_lsh.py`
    
    User guide changes are generated and manually inspected:
    `SKIP_API=1 jekyll build`
    
    Author: Yun Ni <yunn@uber.com>
    Author: Yanbo Liang <ybliang8@gmail.com>
    Author: Yunni <Euler57721@gmail.com>
    
    Closes #16715 from Yunni/spark-18080.