-
- Downloads
[SPARK-14462][ML][MLLIB] Add the mllib-local build to maven pom
## What changes were proposed in this pull request? In order to separate the linear algebra, and vector matrix classes into a standalone jar, we need to setup the build first. This PR will create a new jar called mllib-local with minimal dependencies. The previous PR was failing the build because of `spark-core:test` dependency, and that was reverted. In this PR, `FunSuite` with `// scalastyle:ignore funsuite` in mllib-local test was used, similar to sketch. Thanks. ## How was this patch tested? Unit tests mengxr tedyu holdenk Author: DB Tsai <dbt@netflix.com> Closes #12298 from dbtsai/dbtsai-mllib-local-build-fix.
Showing
- dev/sparktestsupport/modules.py 13 additions, 1 deletiondev/sparktestsupport/modules.py
- mllib-local/pom.xml 87 additions, 0 deletionsmllib-local/pom.xml
- mllib-local/src/main/scala/org/apache/spark/ml/DummyTesting.scala 23 additions, 0 deletions...cal/src/main/scala/org/apache/spark/ml/DummyTesting.scala
- mllib-local/src/test/scala/org/apache/spark/ml/DummyTestingSuite.scala 28 additions, 0 deletions...rc/test/scala/org/apache/spark/ml/DummyTestingSuite.scala
- mllib/pom.xml 12 additions, 0 deletionsmllib/pom.xml
- pom.xml 1 addition, 0 deletionspom.xml
- project/SparkBuild.scala 3 additions, 3 deletionsproject/SparkBuild.scala
Loading
Please register or sign in to comment