-
- Downloads
[SPARK-7535] [.0] [MLLIB] Audit the pipeline APIs for 1.4
Some changes to the pipeilne APIs: 1. Estimator/Transformer/ doesn’t need to extend Params since PipelineStage already does. 1. Move Evaluator to ml.evaluation. 1. Mention larger metric values are better. 1. PipelineModel doc. “compiled” -> “fitted” 1. Hide object PolynomialExpansion. 1. Hide object VectorAssembler. 1. Word2Vec.minCount (and other) -> group param 1. ParamValidators -> DeveloperApi 1. Hide MetadataUtils/SchemaUtils. jkbradley Author: Xiangrui Meng <meng@databricks.com> Closes #6322 from mengxr/SPARK-7535.0 and squashes the following commits: 9e9c7da [Xiangrui Meng] move JavaEvaluator to ml.evaluation as well e179480 [Xiangrui Meng] move Evaluation to ml.evaluation in PySpark 08ef61f [Xiangrui Meng] update pipieline APIs
Showing
- mllib/src/main/scala/org/apache/spark/ml/Estimator.scala 1 addition, 1 deletionmllib/src/main/scala/org/apache/spark/ml/Estimator.scala
- mllib/src/main/scala/org/apache/spark/ml/Pipeline.scala 1 addition, 1 deletionmllib/src/main/scala/org/apache/spark/ml/Pipeline.scala
- mllib/src/main/scala/org/apache/spark/ml/Transformer.scala 1 addition, 1 deletionmllib/src/main/scala/org/apache/spark/ml/Transformer.scala
- mllib/src/main/scala/org/apache/spark/ml/evaluation/BinaryClassificationEvaluator.scala 1 addition, 1 deletion...e/spark/ml/evaluation/BinaryClassificationEvaluator.scala
- mllib/src/main/scala/org/apache/spark/ml/evaluation/Evaluator.scala 2 additions, 2 deletions...main/scala/org/apache/spark/ml/evaluation/Evaluator.scala
- mllib/src/main/scala/org/apache/spark/ml/feature/PolynomialExpansion.scala 1 addition, 1 deletion...ala/org/apache/spark/ml/feature/PolynomialExpansion.scala
- mllib/src/main/scala/org/apache/spark/ml/feature/VectorAssembler.scala 1 addition, 2 deletions...n/scala/org/apache/spark/ml/feature/VectorAssembler.scala
- mllib/src/main/scala/org/apache/spark/ml/feature/Word2Vec.scala 3 additions, 0 deletions...src/main/scala/org/apache/spark/ml/feature/Word2Vec.scala
- mllib/src/main/scala/org/apache/spark/ml/param/params.scala 5 additions, 1 deletionmllib/src/main/scala/org/apache/spark/ml/param/params.scala
- mllib/src/main/scala/org/apache/spark/ml/tuning/CrossValidator.scala 1 addition, 0 deletions...ain/scala/org/apache/spark/ml/tuning/CrossValidator.scala
- mllib/src/main/scala/org/apache/spark/ml/util/MetadataUtils.scala 1 addition, 5 deletions...c/main/scala/org/apache/spark/ml/util/MetadataUtils.scala
- mllib/src/main/scala/org/apache/spark/ml/util/SchemaUtils.scala 2 additions, 4 deletions...src/main/scala/org/apache/spark/ml/util/SchemaUtils.scala
- python/pyspark/ml/__init__.py 2 additions, 2 deletionspython/pyspark/ml/__init__.py
- python/pyspark/ml/evaluation.py 61 additions, 2 deletionspython/pyspark/ml/evaluation.py
- python/pyspark/ml/pipeline.py 0 additions, 37 deletionspython/pyspark/ml/pipeline.py
- python/pyspark/ml/wrapper.py 1 addition, 20 deletionspython/pyspark/ml/wrapper.py
Loading
Please register or sign in to comment