-
- Downloads
[SPARK-16961][CORE] Fixed off-by-one error that biased randomizeInPlace
JIRA issue link: https://issues.apache.org/jira/browse/SPARK-16961 Changed one line of Utils.randomizeInPlace to allow elements to stay in place. Created a unit test that runs a Pearson's chi squared test to determine whether the output diverges significantly from a uniform distribution. Author: Nick Lavers <nick.lavers@videoamp.com> Closes #14551 from nicklavers/SPARK-16961-randomizeInPlace.
Showing
- R/pkg/inst/tests/testthat/test_mllib.R 6 additions, 6 deletionsR/pkg/inst/tests/testthat/test_mllib.R
- core/src/main/scala/org/apache/spark/util/Utils.scala 1 addition, 1 deletioncore/src/main/scala/org/apache/spark/util/Utils.scala
- core/src/test/scala/org/apache/spark/util/UtilsSuite.scala 35 additions, 0 deletionscore/src/test/scala/org/apache/spark/util/UtilsSuite.scala
- python/pyspark/ml/clustering.py 6 additions, 6 deletionspython/pyspark/ml/clustering.py
- python/pyspark/mllib/clustering.py 1 addition, 1 deletionpython/pyspark/mllib/clustering.py
- python/pyspark/mllib/tests.py 1 addition, 1 deletionpython/pyspark/mllib/tests.py
Loading
Please register or sign in to comment