-
- Downloads
[SPARK-21221][ML] CrossValidator and TrainValidationSplit Persist Nested...
[SPARK-21221][ML] CrossValidator and TrainValidationSplit Persist Nested Estimators such as OneVsRest ## What changes were proposed in this pull request? Added functionality for CrossValidator and TrainValidationSplit to persist nested estimators such as OneVsRest. Also added CrossValidator and TrainValidation split persistence to pyspark. ## How was this patch tested? Performed both cross validation and train validation split with a one vs. rest estimator and tested read/write functionality of the estimator parameter maps required by these meta-algorithms. Author: Ajay Saini <ajays725@gmail.com> Closes #18428 from ajaysaini725/MetaAlgorithmPersistNestedEstimators.
Showing
- mllib/src/main/scala/org/apache/spark/ml/tuning/ValidatorParams.scala 28 additions, 3 deletions...in/scala/org/apache/spark/ml/tuning/ValidatorParams.scala
- mllib/src/test/scala/org/apache/spark/ml/tuning/CrossValidatorSuite.scala 80 additions, 23 deletions...cala/org/apache/spark/ml/tuning/CrossValidatorSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/tuning/TrainValidationSplitSuite.scala 80 additions, 4 deletions...rg/apache/spark/ml/tuning/TrainValidationSplitSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/tuning/ValidatorParamsSuiteHelpers.scala 86 additions, 0 deletions.../apache/spark/ml/tuning/ValidatorParamsSuiteHelpers.scala
- mllib/src/test/scala/org/apache/spark/ml/util/DefaultReadWriteTest.scala 0 additions, 1 deletion...scala/org/apache/spark/ml/util/DefaultReadWriteTest.scala
- python/pyspark/ml/classification.py 57 additions, 35 deletionspython/pyspark/ml/classification.py
- python/pyspark/ml/tests.py 142 additions, 3 deletionspython/pyspark/ml/tests.py
- python/pyspark/ml/tuning.py 222 additions, 4 deletionspython/pyspark/ml/tuning.py
- python/pyspark/ml/wrapper.py 1 addition, 1 deletionpython/pyspark/ml/wrapper.py
Loading
Please register or sign in to comment