-
- Downloads
[SPARK-7380] [MLLIB] pipeline stages should be copyable in Python
This PR makes pipeline stages in Python copyable and hence simplifies some implementations. It also includes the following changes: 1. Rename `paramMap` and `defaultParamMap` to `_paramMap` and `_defaultParamMap`, respectively. 2. Accept a list of param maps in `fit`. 3. Use parent uid and name to identify param. jkbradley Author: Xiangrui Meng <meng@databricks.com> Author: Joseph K. Bradley <joseph@databricks.com> Closes #6088 from mengxr/SPARK-7380 and squashes the following commits: 413c463 [Xiangrui Meng] remove unnecessary doc 4159f35 [Xiangrui Meng] Merge remote-tracking branch 'apache/master' into SPARK-7380 611c719 [Xiangrui Meng] fix python style 68862b8 [Xiangrui Meng] update _java_obj initialization 927ad19 [Xiangrui Meng] fix ml/tests.py 0138fc3 [Xiangrui Meng] update feature transformers and fix a bug in RegexTokenizer 9ca44fb [Xiangrui Meng] simplify Java wrappers and add tests c7d84ef [Xiangrui Meng] update ml/tests.py to test copy params 7e0d27f [Xiangrui Meng] merge master 46840fb [Xiangrui Meng] update wrappers b6db1ed [Xiangrui Meng] update all self.paramMap to self._paramMap 46cb6ed [Xiangrui Meng] merge master a163413 [Xiangrui Meng] fix style 1042e80 [Xiangrui Meng] Merge remote-tracking branch 'apache/master' into SPARK-7380 9630eae [Xiangrui Meng] fix Identifiable._randomUID 13bd70a [Xiangrui Meng] update ml/tests.py 64a536c [Xiangrui Meng] use _fit/_transform/_evaluate to simplify the impl 02abf13 [Xiangrui Meng] Merge remote-tracking branch 'apache/master' into copyable-python 66ce18c [Joseph K. Bradley] some cleanups before sending to Xiangrui 7431272 [Joseph K. Bradley] Rebased with master
Showing
- mllib/src/main/scala/org/apache/spark/ml/feature/Tokenizer.scala 1 addition, 1 deletion...rc/main/scala/org/apache/spark/ml/feature/Tokenizer.scala
- mllib/src/main/scala/org/apache/spark/ml/param/params.scala 3 additions, 4 deletionsmllib/src/main/scala/org/apache/spark/ml/param/params.scala
- mllib/src/main/scala/org/apache/spark/ml/util/Identifiable.scala 4 additions, 2 deletions...rc/main/scala/org/apache/spark/ml/util/Identifiable.scala
- python/pyspark/ml/classification.py 20 additions, 15 deletionspython/pyspark/ml/classification.py
- python/pyspark/ml/evaluation.py 3 additions, 3 deletionspython/pyspark/ml/evaluation.py
- python/pyspark/ml/feature.py 52 additions, 39 deletionspython/pyspark/ml/feature.py
- python/pyspark/ml/param/__init__.py 84 additions, 34 deletionspython/pyspark/ml/param/__init__.py
- python/pyspark/ml/param/_shared_params_code_gen.py 1 addition, 1 deletionpython/pyspark/ml/param/_shared_params_code_gen.py
- python/pyspark/ml/param/shared.py 21 additions, 21 deletionspython/pyspark/ml/param/shared.py
- python/pyspark/ml/pipeline.py 85 additions, 24 deletionspython/pyspark/ml/pipeline.py
- python/pyspark/ml/recommendation.py 13 additions, 12 deletionspython/pyspark/ml/recommendation.py
- python/pyspark/ml/regression.py 17 additions, 13 deletionspython/pyspark/ml/regression.py
- python/pyspark/ml/tests.py 73 additions, 32 deletionspython/pyspark/ml/tests.py
- python/pyspark/ml/tuning.py 31 additions, 12 deletionspython/pyspark/ml/tuning.py
- python/pyspark/ml/util.py 10 additions, 3 deletionspython/pyspark/ml/util.py
- python/pyspark/ml/wrapper.py 80 additions, 45 deletionspython/pyspark/ml/wrapper.py
Loading
Please register or sign in to comment