-
- Downloads
[SPARK-14899][ML][PYSPARK] Remove spark.ml HashingTF hashingAlg option
## What changes were proposed in this pull request? Since [SPARK-10574](https://issues.apache.org/jira/browse/SPARK-10574) breaks behavior of ```HashingTF```, we should try to enforce good practice by removing the "native" hashAlgorithm option in spark.ml and pyspark.ml. We can leave spark.mllib and pyspark.mllib alone. ## How was this patch tested? Unit tests. cc jkbradley Author: Yanbo Liang <ybliang8@gmail.com> Closes #12702 from yanboliang/spark-14899.
Showing
- mllib/src/main/scala/org/apache/spark/ml/feature/HashingTF.scala 7 additions, 29 deletions...rc/main/scala/org/apache/spark/ml/feature/HashingTF.scala
- mllib/src/main/scala/org/apache/spark/mllib/feature/HashingTF.scala 2 additions, 2 deletions...main/scala/org/apache/spark/mllib/feature/HashingTF.scala
- mllib/src/test/scala/org/apache/spark/ml/feature/HashingTFSuite.scala 13 additions, 24 deletions...st/scala/org/apache/spark/ml/feature/HashingTFSuite.scala
- python/pyspark/ml/feature.py 11 additions, 30 deletionspython/pyspark/ml/feature.py
- python/pyspark/ml/tests.py 3 additions, 6 deletionspython/pyspark/ml/tests.py
Loading
Please register or sign in to comment