-
- Downloads
[SPARK-16356][ML] Add testImplicits for ML unit tests and promote toDF()
## What changes were proposed in this pull request? This was suggested in https://github.com/apache/spark/commit/101663f1ae222a919fc40510aa4f2bad22d1be6f#commitcomment-17114968. This PR adds `testImplicits` to `MLlibTestSparkContext` so that some implicits such as `toDF()` can be sued across ml tests. This PR also changes all the usages of `spark.createDataFrame( ... )` to `toDF()` where applicable in ml tests in Scala. ## How was this patch tested? Existing tests should work. Author: hyukjinkwon <gurwls223@gmail.com> Closes #14035 from HyukjinKwon/minor-ml-test.
Showing
- mllib/src/test/scala/org/apache/spark/ml/PipelineSuite.scala 7 additions, 6 deletionsmllib/src/test/scala/org/apache/spark/ml/PipelineSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/classification/ClassifierSuite.scala 6 additions, 10 deletions.../org/apache/spark/ml/classification/ClassifierSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/classification/DecisionTreeClassifierSuite.scala 2 additions, 1 deletion...spark/ml/classification/DecisionTreeClassifierSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/classification/GBTClassifierSuite.scala 3 additions, 3 deletions...g/apache/spark/ml/classification/GBTClassifierSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/classification/LogisticRegressionSuite.scala 20 additions, 23 deletions...che/spark/ml/classification/LogisticRegressionSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/classification/MultilayerPerceptronClassifierSuite.scala 14 additions, 12 deletions.../classification/MultilayerPerceptronClassifierSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/classification/NaiveBayesSuite.scala 11 additions, 9 deletions.../org/apache/spark/ml/classification/NaiveBayesSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/classification/OneVsRestSuite.scala 3 additions, 1 deletion...a/org/apache/spark/ml/classification/OneVsRestSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/classification/RandomForestClassifierSuite.scala 2 additions, 1 deletion...spark/ml/classification/RandomForestClassifierSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/clustering/LDASuite.scala 4 additions, 2 deletions.../test/scala/org/apache/spark/ml/clustering/LDASuite.scala
- mllib/src/test/scala/org/apache/spark/ml/evaluation/BinaryClassificationEvaluatorSuite.scala 8 additions, 6 deletions...rk/ml/evaluation/BinaryClassificationEvaluatorSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/evaluation/RegressionEvaluatorSuite.scala 5 additions, 3 deletions...apache/spark/ml/evaluation/RegressionEvaluatorSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/feature/BinarizerSuite.scala 8 additions, 8 deletions...st/scala/org/apache/spark/ml/feature/BinarizerSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/feature/BucketizerSuite.scala 7 additions, 8 deletions...t/scala/org/apache/spark/ml/feature/BucketizerSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/feature/ChiSqSelectorSuite.scala 1 addition, 2 deletions...cala/org/apache/spark/ml/feature/ChiSqSelectorSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/feature/CountVectorizerSuite.scala 16 additions, 14 deletions...la/org/apache/spark/ml/feature/CountVectorizerSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/feature/DCTSuite.scala 5 additions, 5 deletions...src/test/scala/org/apache/spark/ml/feature/DCTSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/feature/HashingTFSuite.scala 4 additions, 6 deletions...st/scala/org/apache/spark/ml/feature/HashingTFSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/feature/IDFSuite.scala 4 additions, 2 deletions...src/test/scala/org/apache/spark/ml/feature/IDFSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/feature/InteractionSuite.scala 25 additions, 28 deletions.../scala/org/apache/spark/ml/feature/InteractionSuite.scala
Loading
Please register or sign in to comment