Skip to content
Snippets Groups Projects
  • Xiangrui Meng's avatar
    8f11c611
    [SPARK-7535] [.0] [MLLIB] Audit the pipeline APIs for 1.4 · 8f11c611
    Xiangrui Meng authored
    Some changes to the pipeilne APIs:
    
    1. Estimator/Transformer/ doesn’t need to extend Params since PipelineStage already does.
    1. Move Evaluator to ml.evaluation.
    1. Mention larger metric values are better.
    1. PipelineModel doc. “compiled” -> “fitted”
    1. Hide object PolynomialExpansion.
    1. Hide object VectorAssembler.
    1. Word2Vec.minCount (and other) -> group param
    1. ParamValidators -> DeveloperApi
    1. Hide MetadataUtils/SchemaUtils.
    
    jkbradley
    
    Author: Xiangrui Meng <meng@databricks.com>
    
    Closes #6322 from mengxr/SPARK-7535.0 and squashes the following commits:
    
    9e9c7da [Xiangrui Meng] move JavaEvaluator to ml.evaluation as well
    e179480 [Xiangrui Meng] move Evaluation to ml.evaluation in PySpark
    08ef61f [Xiangrui Meng] update pipieline APIs
    8f11c611
    History
    [SPARK-7535] [.0] [MLLIB] Audit the pipeline APIs for 1.4
    Xiangrui Meng authored
    Some changes to the pipeilne APIs:
    
    1. Estimator/Transformer/ doesn’t need to extend Params since PipelineStage already does.
    1. Move Evaluator to ml.evaluation.
    1. Mention larger metric values are better.
    1. PipelineModel doc. “compiled” -> “fitted”
    1. Hide object PolynomialExpansion.
    1. Hide object VectorAssembler.
    1. Word2Vec.minCount (and other) -> group param
    1. ParamValidators -> DeveloperApi
    1. Hide MetadataUtils/SchemaUtils.
    
    jkbradley
    
    Author: Xiangrui Meng <meng@databricks.com>
    
    Closes #6322 from mengxr/SPARK-7535.0 and squashes the following commits:
    
    9e9c7da [Xiangrui Meng] move JavaEvaluator to ml.evaluation as well
    e179480 [Xiangrui Meng] move Evaluation to ml.evaluation in PySpark
    08ef61f [Xiangrui Meng] update pipieline APIs