-
- Downloads
[SPARK-4588] ML Attributes
This continues the work in #4460 from srowen . The design doc is published on the JIRA page with some minor changes. Short description of ML attributes: https://github.com/apache/spark/pull/4925/files?diff=unified#diff-95e7f5060429f189460b44a3f8731a35R24 More details can be found in the design doc. srowen Could you help review this PR? There are many lines but most of them are boilerplate code. Author: Xiangrui Meng <meng@databricks.com> Author: Sean Owen <sowen@cloudera.com> Closes #4925 from mengxr/SPARK-4588-new and squashes the following commits: 71d1bd0 [Xiangrui Meng] add JavaDoc for package ml.attribute 617be40 [Xiangrui Meng] remove final; rename cardinality to numValues 393ffdc [Xiangrui Meng] forgot to include Java attribute group tests b1aceef [Xiangrui Meng] more tests e7ab467 [Xiangrui Meng] update ML attribute impl 7c944da [Sean Owen] Add FeatureType hierarchy and categorical cardinality 2a21d6d [Sean Owen] Initial draft of FeatureAttributes class
Showing
- mllib/src/main/scala/org/apache/spark/ml/attribute/AttributeGroup.scala 234 additions, 0 deletions.../scala/org/apache/spark/ml/attribute/AttributeGroup.scala
- mllib/src/main/scala/org/apache/spark/ml/attribute/AttributeKeys.scala 37 additions, 0 deletions...n/scala/org/apache/spark/ml/attribute/AttributeKeys.scala
- mllib/src/main/scala/org/apache/spark/ml/attribute/AttributeType.scala 61 additions, 0 deletions...n/scala/org/apache/spark/ml/attribute/AttributeType.scala
- mllib/src/main/scala/org/apache/spark/ml/attribute/attributes.scala 512 additions, 0 deletions...main/scala/org/apache/spark/ml/attribute/attributes.scala
- mllib/src/main/scala/org/apache/spark/ml/attribute/package-info.java 41 additions, 0 deletions...ain/scala/org/apache/spark/ml/attribute/package-info.java
- mllib/src/main/scala/org/apache/spark/ml/attribute/package.scala 44 additions, 0 deletions...rc/main/scala/org/apache/spark/ml/attribute/package.scala
- mllib/src/test/java/org/apache/spark/ml/attribute/JavaAttributeGroupSuite.java 45 additions, 0 deletions...rg/apache/spark/ml/attribute/JavaAttributeGroupSuite.java
- mllib/src/test/java/org/apache/spark/ml/attribute/JavaAttributeSuite.java 55 additions, 0 deletions...ava/org/apache/spark/ml/attribute/JavaAttributeSuite.java
- mllib/src/test/scala/org/apache/spark/ml/attribute/AttributeGroupSuite.scala 65 additions, 0 deletions...a/org/apache/spark/ml/attribute/AttributeGroupSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/attribute/AttributeSuite.scala 212 additions, 0 deletions.../scala/org/apache/spark/ml/attribute/AttributeSuite.scala
- project/SparkBuild.scala 2 additions, 1 deletionproject/SparkBuild.scala
Loading
Please register or sign in to comment