-
- Downloads
[SPARK-3128][MLLIB] Use streaming test suite for StreamingLR
Refactored tests for streaming linear regression to use existing streaming test utilities. Summary of changes: - Made ``mllib`` depend on tests from ``streaming`` - Rewrote accuracy and convergence tests to use ``setupStreams`` and ``runStreams`` - Added new test for the accuracy of predictions generated by ``predictOnValue`` These tests should run faster, be easier to extend/maintain, and provide a reference for new tests. mengxr tdas Author: freeman <the.freeman.lab@gmail.com> Closes #2037 from freeman-lab/streamingLR-predict-tests and squashes the following commits: e851ca7 [freeman] Fixed long lines 50eb0bf [freeman] Refactored tests to use streaming test tools 32c43c2 [freeman] Added test for prediction
Showing
- mllib/pom.xml 7 additions, 0 deletionsmllib/pom.xml
- mllib/src/test/scala/org/apache/spark/mllib/regression/StreamingLinearRegressionSuite.scala 67 additions, 54 deletions...ark/mllib/regression/StreamingLinearRegressionSuite.scala
- streaming/src/test/scala/org/apache/spark/streaming/TestSuiteBase.scala 3 additions, 1 deletion...test/scala/org/apache/spark/streaming/TestSuiteBase.scala
Loading
Please register or sign in to comment