-
- Downloads
[SPARK-18501][ML][SPARKR] Fix spark.glm errors when fitting on collinear data
## What changes were proposed in this pull request? * Fix SparkR ```spark.glm``` errors when fitting on collinear data, since ```standard error of coefficients, t value and p value``` are not available in this condition. * Scala/Python GLM summary should throw exception if users get ```standard error of coefficients, t value and p value``` but the underlying WLS was solved by local "l-bfgs". ## How was this patch tested? Add unit tests. Author: Yanbo Liang <ybliang8@gmail.com> Closes #15930 from yanboliang/spark-18501. (cherry picked from commit 982b82e3) Signed-off-by:Yanbo Liang <ybliang8@gmail.com>
Showing
- R/pkg/R/mllib.R 16 additions, 5 deletionsR/pkg/R/mllib.R
- R/pkg/inst/tests/testthat/test_mllib.R 9 additions, 0 deletionsR/pkg/inst/tests/testthat/test_mllib.R
- mllib/src/main/scala/org/apache/spark/ml/r/GeneralizedLinearRegressionWrapper.scala 31 additions, 23 deletions...pache/spark/ml/r/GeneralizedLinearRegressionWrapper.scala
- mllib/src/main/scala/org/apache/spark/ml/regression/GeneralizedLinearRegression.scala 38 additions, 8 deletions...che/spark/ml/regression/GeneralizedLinearRegression.scala
- mllib/src/test/scala/org/apache/spark/ml/regression/GeneralizedLinearRegressionSuite.scala 21 additions, 0 deletions...park/ml/regression/GeneralizedLinearRegressionSuite.scala
Loading
Please register or sign in to comment