Skip to content
Snippets Groups Projects
Commit 89a41c5b authored by Oliver Pierson's avatar Oliver Pierson Committed by Xiangrui Meng
Browse files

[SPARK-13600][MLLIB] Use approxQuantile from DataFrame stats in QuantileDiscretizer 

## What changes were proposed in this pull request?
QuantileDiscretizer can return an unexpected number of buckets in certain cases.  This PR proposes to fix this issue and also refactor QuantileDiscretizer to use approxQuantiles from DataFrame stats functions.
## How was this patch tested?
QuantileDiscretizerSuite unit tests (some existing tests will change or even be removed in this PR)

Author: Oliver Pierson <ocp@gatech.edu>

Closes #11553 from oliverpierson/SPARK-13600.
parent 2dacc81e
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment