-
- Downloads
[SPARK-5867] [SPARK-5892] [doc] [ml] [mllib] Doc cleanups for 1.3 release
For SPARK-5867: * The spark.ml programming guide needs to be updated to use the new SQL DataFrame API instead of the old SchemaRDD API. * It should also include Python examples now. For SPARK-5892: * Fix Python docs * Various other cleanups BTW, I accidentally merged this with master. If you want to compile it on your own, use this branch which is based on spark/branch-1.3 and cherry-picks the commits from this PR: [https://github.com/jkbradley/spark/tree/doc-review-1.3-check] CC: mengxr (ML), davies (Python docs) Author: Joseph K. Bradley <joseph@databricks.com> Closes #4675 from jkbradley/doc-review-1.3 and squashes the following commits: f191bb0 [Joseph K. Bradley] small cleanups e786efa [Joseph K. Bradley] small doc corrections 6b1ab4a [Joseph K. Bradley] fixed python lint test 946affa [Joseph K. Bradley] Added sample data for ml.MovieLensALS example. Changed spark.ml Java examples to use DataFrames API instead of sql() da81558 [Joseph K. Bradley] Merge remote-tracking branch 'upstream/master' into doc-review-1.3 629dbf5 [Joseph K. Bradley] Updated based on code review: * made new page for old migration guides * small fixes * moved inherit_doc in python b9df7c4 [Joseph K. Bradley] Small cleanups: toDF to toDF(), adding s for string interpolation 34b067f [Joseph K. Bradley] small doc correction da16aef [Joseph K. Bradley] Fixed python mllib docs 8cce91c [Joseph K. Bradley] GMM: removed old imports, added some doc 695f3f6 [Joseph K. Bradley] partly done trying to fix inherit_doc for class hierarchies in python docs a72c018 [Joseph K. Bradley] made ChiSqTestResult appear in python docs b05a80d [Joseph K. Bradley] organize imports. doc cleanups e572827 [Joseph K. Bradley] updated programming guide for ml and mllib
Showing
- data/mllib/als/sample_movielens_movies.txt 100 additions, 0 deletionsdata/mllib/als/sample_movielens_movies.txt
- data/mllib/als/sample_movielens_ratings.txt 1501 additions, 0 deletionsdata/mllib/als/sample_movielens_ratings.txt
- docs/ml-guide.md 155 additions, 94 deletionsdocs/ml-guide.md
- docs/mllib-guide.md 15 additions, 118 deletionsdocs/mllib-guide.md
- docs/mllib-migration-guides.md 67 additions, 0 deletionsdocs/mllib-migration-guides.md
- examples/src/main/java/org/apache/spark/examples/ml/JavaCrossValidatorExample.java 3 additions, 4 deletions...g/apache/spark/examples/ml/JavaCrossValidatorExample.java
- examples/src/main/java/org/apache/spark/examples/ml/JavaSimpleParamsExample.java 3 additions, 5 deletions...org/apache/spark/examples/ml/JavaSimpleParamsExample.java
- examples/src/main/java/org/apache/spark/examples/ml/JavaSimpleTextClassificationPipeline.java 3 additions, 4 deletions...ark/examples/ml/JavaSimpleTextClassificationPipeline.java
- examples/src/main/python/ml/simple_text_classification_pipeline.py 2 additions, 2 deletions...src/main/python/ml/simple_text_classification_pipeline.py
- examples/src/main/scala/org/apache/spark/examples/ml/CrossValidatorExample.scala 1 addition, 1 deletion.../org/apache/spark/examples/ml/CrossValidatorExample.scala
- examples/src/main/scala/org/apache/spark/examples/ml/MovieLensALS.scala 19 additions, 13 deletions...ain/scala/org/apache/spark/examples/ml/MovieLensALS.scala
- examples/src/main/scala/org/apache/spark/examples/ml/SimpleParamsExample.scala 3 additions, 3 deletions...la/org/apache/spark/examples/ml/SimpleParamsExample.scala
- examples/src/main/scala/org/apache/spark/examples/ml/SimpleTextClassificationPipeline.scala 1 addition, 1 deletion.../spark/examples/ml/SimpleTextClassificationPipeline.scala
- mllib/src/main/scala/org/apache/spark/mllib/clustering/GaussianMixture.scala 7 additions, 5 deletions...a/org/apache/spark/mllib/clustering/GaussianMixture.scala
- mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala 3 additions, 3 deletions...c/main/scala/org/apache/spark/mllib/linalg/Matrices.scala
- mllib/src/main/scala/org/apache/spark/mllib/linalg/Vectors.scala 1 addition, 1 deletion...rc/main/scala/org/apache/spark/mllib/linalg/Vectors.scala
- mllib/src/main/scala/org/apache/spark/mllib/optimization/Gradient.scala 12 additions, 2 deletions.../scala/org/apache/spark/mllib/optimization/Gradient.scala
- python/docs/pyspark.mllib.rst 3 additions, 8 deletionspython/docs/pyspark.mllib.rst
- python/pyspark/ml/classification.py 2 additions, 1 deletionpython/pyspark/ml/classification.py
- python/pyspark/ml/feature.py 2 additions, 1 deletionpython/pyspark/ml/feature.py
Loading
Please register or sign in to comment