-
- Downloads
[SPARK-14462][ML][MLLIB] add the mllib-local build to maven pom
## What changes were proposed in this pull request? In order to separate the linear algebra, and vector matrix classes into a standalone jar, we need to setup the build first. This PR will create a new jar called mllib-local with minimal dependencies. The test scope will still depend on spark-core and spark-core-test in order to use the common utilities, but the runtime will avoid any platform dependency. Couple platform independent classes will be moved to this package to demonstrate how this work. ## How was this patch tested? Unit tests Author: DB Tsai <dbt@netflix.com> Closes #12241 from dbtsai/dbtsai-mllib-local-build.
Showing
- dev/sparktestsupport/modules.py 13 additions, 1 deletiondev/sparktestsupport/modules.py
- mllib-local/pom.xml 94 additions, 0 deletionsmllib-local/pom.xml
- mllib-local/src/main/scala/org/apache/spark/ml/DummyTesting.scala 23 additions, 0 deletions...cal/src/main/scala/org/apache/spark/ml/DummyTesting.scala
- mllib-local/src/test/scala/org/apache/spark/ml/DummyTestingSuite.scala 28 additions, 0 deletions...rc/test/scala/org/apache/spark/ml/DummyTestingSuite.scala
- mllib/pom.xml 12 additions, 0 deletionsmllib/pom.xml
- pom.xml 1 addition, 0 deletionspom.xml
- project/SparkBuild.scala 3 additions, 3 deletionsproject/SparkBuild.scala
Loading
Please register or sign in to comment