-
- Downloads
[SPARK-8936] [MLLIB] OnlineLDA document-topic Dirichlet hyperparameter optimization
Adds `alpha` (document-topic Dirichlet parameter) hyperparameter optimization to `OnlineLDAOptimizer` following Huang: Maximum Likelihood Estimation of Dirichlet Distribution Parameters. Also introduces a private `setSampleWithReplacement` to `OnlineLDAOptimizer` for unit testing purposes. Author: Feynman Liang <fliang@databricks.com> Closes #7836 from feynmanliang/SPARK-8936-alpha-optimize and squashes the following commits: 4bef484 [Feynman Liang] Documentation improvements c3c6c1d [Feynman Liang] Fix docs 151e859 [Feynman Liang] Fix style fa77518 [Feynman Liang] Hyperparameter optimization
Showing
- mllib/src/main/scala/org/apache/spark/mllib/clustering/LDAOptimizer.scala 65 additions, 10 deletions...cala/org/apache/spark/mllib/clustering/LDAOptimizer.scala
- mllib/src/test/scala/org/apache/spark/mllib/clustering/LDASuite.scala 34 additions, 0 deletions...st/scala/org/apache/spark/mllib/clustering/LDASuite.scala
Loading
Please register or sign in to comment