-
- Downloads
[SPARK-13017][DOCS] Replace example code in mllib-feature-extraction.md using include_example
Replace example code in mllib-feature-extraction.md using include_example https://issues.apache.org/jira/browse/SPARK-13017 The example code in the user guide is embedded in the markdown and hence it is not easy to test. It would be nice to automatically test them. This JIRA is to discuss options to automate example code testing and see what we can do in Spark 1.6. Goal is to move actual example code to spark/examples and test compilation in Jenkins builds. Then in the markdown, we can reference part of the code to show in the user guide. This requires adding a Jekyll tag that is similar to https://github.com/jekyll/jekyll/blob/master/lib/jekyll/tags/include.rb, e.g., called include_example. `{% include_example scala/org/apache/spark/examples/mllib/TFIDFExample.scala %}` Jekyll will find `examples/src/main/scala/org/apache/spark/examples/mllib/TFIDFExample.scala` and pick code blocks marked "example" and replace code block in `{% highlight %}` in the markdown. See more sub-tasks in parent ticket: https://issues.apache.org/jira/browse/SPARK-11337 Author: Xin Ren <iamshrek@126.com> Closes #11142 from keypointt/SPARK-13017.
Showing
- docs/mllib-feature-extraction.md 14 additions, 361 deletionsdocs/mllib-feature-extraction.md
- examples/src/main/java/org/apache/spark/examples/mllib/JavaChiSqSelectorExample.java 83 additions, 0 deletions...apache/spark/examples/mllib/JavaChiSqSelectorExample.java
- examples/src/main/java/org/apache/spark/examples/mllib/JavaElementwiseProductExample.java 78 additions, 0 deletions...e/spark/examples/mllib/JavaElementwiseProductExample.java
- examples/src/main/python/mllib/elementwise_product_example.py 51 additions, 0 deletions...ples/src/main/python/mllib/elementwise_product_example.py
- examples/src/main/python/mllib/normalizer_example.py 52 additions, 0 deletionsexamples/src/main/python/mllib/normalizer_example.py
- examples/src/main/python/mllib/standard_scaler_example.py 55 additions, 0 deletionsexamples/src/main/python/mllib/standard_scaler_example.py
- examples/src/main/python/mllib/tf_idf_example.py 57 additions, 0 deletionsexamples/src/main/python/mllib/tf_idf_example.py
- examples/src/main/python/mllib/word2vec_example.py 40 additions, 0 deletionsexamples/src/main/python/mllib/word2vec_example.py
- examples/src/main/scala/org/apache/spark/examples/mllib/ChiSqSelectorExample.scala 61 additions, 0 deletions...rg/apache/spark/examples/mllib/ChiSqSelectorExample.scala
- examples/src/main/scala/org/apache/spark/examples/mllib/ElementwiseProductExample.scala 56 additions, 0 deletions...ache/spark/examples/mllib/ElementwiseProductExample.scala
- examples/src/main/scala/org/apache/spark/examples/mllib/NormalizerExample.scala 57 additions, 0 deletions...a/org/apache/spark/examples/mllib/NormalizerExample.scala
- examples/src/main/scala/org/apache/spark/examples/mllib/PCAExample.scala 74 additions, 0 deletions...in/scala/org/apache/spark/examples/mllib/PCAExample.scala
- examples/src/main/scala/org/apache/spark/examples/mllib/StandardScalerExample.scala 62 additions, 0 deletions...g/apache/spark/examples/mllib/StandardScalerExample.scala
- examples/src/main/scala/org/apache/spark/examples/mllib/TFIDFExample.scala 66 additions, 0 deletions.../scala/org/apache/spark/examples/mllib/TFIDFExample.scala
- examples/src/main/scala/org/apache/spark/examples/mllib/Word2VecExample.scala 55 additions, 0 deletions...ala/org/apache/spark/examples/mllib/Word2VecExample.scala
Loading
Please register or sign in to comment