-
- Downloads
[SPARK-17001][ML] Enable standardScaler to standardize sparse vectors when withMean=True
## What changes were proposed in this pull request? Allow centering / mean scaling of sparse vectors in StandardScaler, if requested. This is for compatibility with `VectorAssembler` in common usages. ## How was this patch tested? Jenkins tests, including new caes to reflect the new behavior. Author: Sean Owen <sowen@cloudera.com> Closes #14663 from srowen/SPARK-17001.
Showing
- docs/ml-features.md 1 addition, 1 deletiondocs/ml-features.md
- docs/mllib-feature-extraction.md 1 addition, 1 deletiondocs/mllib-feature-extraction.md
- examples/src/main/python/mllib/standard_scaler_example.py 0 additions, 2 deletionsexamples/src/main/python/mllib/standard_scaler_example.py
- examples/src/main/scala/org/apache/spark/examples/mllib/StandardScalerExample.scala 0 additions, 2 deletions...g/apache/spark/examples/mllib/StandardScalerExample.scala
- mllib/src/main/scala/org/apache/spark/ml/feature/StandardScaler.scala 1 addition, 2 deletions...in/scala/org/apache/spark/ml/feature/StandardScaler.scala
- mllib/src/main/scala/org/apache/spark/mllib/feature/StandardScaler.scala 21 additions, 20 deletions...scala/org/apache/spark/mllib/feature/StandardScaler.scala
- mllib/src/test/scala/org/apache/spark/ml/feature/StandardScalerSuite.scala 16 additions, 0 deletions...ala/org/apache/spark/ml/feature/StandardScalerSuite.scala
- mllib/src/test/scala/org/apache/spark/mllib/feature/StandardScalerSuite.scala 38 additions, 31 deletions.../org/apache/spark/mllib/feature/StandardScalerSuite.scala
- python/pyspark/mllib/feature.py 2 additions, 3 deletionspython/pyspark/mllib/feature.py
Loading
Please register or sign in to comment