-
- Downloads
[SPARK-3136][MLLIB] Create Java-friendly methods in RandomRDDs
Though we don't use default argument for methods in RandomRDDs, it is still not easy for Java users to use because the output type is either `RDD[Double]` or `RDD[Vector]`. Java users should expect `JavaDoubleRDD` and `JavaRDD[Vector]`, respectively. We should create dedicated methods for Java users, and allow default arguments in Scala methods in RandomRDDs, to make life easier for both Java and Scala users. This PR also contains documentation for random data generation. brkyvz Author: Xiangrui Meng <meng@databricks.com> Closes #2041 from mengxr/stat-doc and squashes the following commits: fc5eedf [Xiangrui Meng] add missing comma ffde810 [Xiangrui Meng] address comments aef6d07 [Xiangrui Meng] add doc for random data generation b99d94b [Xiangrui Meng] add java-friendly methods to RandomRDDs
Showing
- docs/mllib-guide.md 1 addition, 1 deletiondocs/mllib-guide.md
- docs/mllib-stats.md 73 additions, 1 deletiondocs/mllib-stats.md
- mllib/src/main/scala/org/apache/spark/mllib/random/RandomDataGenerator.scala 9 additions, 9 deletions...a/org/apache/spark/mllib/random/RandomDataGenerator.scala
- mllib/src/main/scala/org/apache/spark/mllib/random/RandomRDDs.scala 191 additions, 285 deletions...main/scala/org/apache/spark/mllib/random/RandomRDDs.scala
- mllib/src/test/java/org/apache/spark/mllib/random/JavaRandomRDDsSuite.java 134 additions, 0 deletions...va/org/apache/spark/mllib/random/JavaRandomRDDsSuite.java
- python/pyspark/mllib/random.py 10 additions, 10 deletionspython/pyspark/mllib/random.py
Loading
Please register or sign in to comment