-
- Downloads
[SPARK-3418] Sparse Matrix support (CCS) and additional native BLAS operations added
Local `SparseMatrix` support added in Compressed Column Storage (CCS) format in addition to Level-2 and Level-3 BLAS operations such as dgemv and dgemm respectively. BLAS doesn't support sparse matrix operations, therefore support for `SparseMatrix`-`DenseMatrix` multiplication and `SparseMatrix`-`DenseVector` implementations have been added. I will post performance comparisons in the comments momentarily. Author: Burak <brkyvz@gmail.com> Closes #2294 from brkyvz/SPARK-3418 and squashes the following commits: 88814ed [Burak] Hopefully fixed MiMa this time 47e49d5 [Burak] really fixed MiMa issue f0bae57 [Burak] [SPARK-3418] Fixed MiMa compatibility issues (excluded from check) 4b7dbec [Burak] 9/17 comments addressed 7af2f83 [Burak] sealed traits Vector and Matrix d3a8a16 [Burak] [SPARK-3418] Squashed missing alpha bug. 421045f [Burak] [SPARK-3418] New code review comments addressed f35a161 [Burak] [SPARK-3418] Code review comments addressed and multiplication further optimized 2508577 [Burak] [SPARK-3418] Fixed one more style issue d16e8a0 [Burak] [SPARK-3418] Fixed style issues and added documentation for methods 204a3f7 [Burak] [SPARK-3418] Fixed failing Matrix unit test 6025297 [Burak] [SPARK-3418] Fixed Scala-style errors dc7be71 [Burak] [SPARK-3418][MLlib] Matrix unit tests expanded with indexing and updating d2d5851 [Burak] [SPARK-3418][MLlib] Sparse Matrix support and additional native BLAS operations added
Showing
- mllib/src/main/scala/org/apache/spark/mllib/linalg/BLAS.scala 329 additions, 1 deletion...b/src/main/scala/org/apache/spark/mllib/linalg/BLAS.scala
- mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala 227 additions, 5 deletions...c/main/scala/org/apache/spark/mllib/linalg/Matrices.scala
- mllib/src/main/scala/org/apache/spark/mllib/linalg/Vectors.scala 1 addition, 1 deletion...rc/main/scala/org/apache/spark/mllib/linalg/Vectors.scala
- mllib/src/test/scala/org/apache/spark/mllib/linalg/BLASSuite.scala 111 additions, 0 deletions.../test/scala/org/apache/spark/mllib/linalg/BLASSuite.scala
- mllib/src/test/scala/org/apache/spark/mllib/linalg/BreezeMatrixConversionSuite.scala 23 additions, 1 deletion...ache/spark/mllib/linalg/BreezeMatrixConversionSuite.scala
- mllib/src/test/scala/org/apache/spark/mllib/linalg/MatricesSuite.scala 76 additions, 0 deletions...t/scala/org/apache/spark/mllib/linalg/MatricesSuite.scala
- mllib/src/test/scala/org/apache/spark/mllib/util/TestingUtils.scala 64 additions, 1 deletion...test/scala/org/apache/spark/mllib/util/TestingUtils.scala
- project/MimaExcludes.scala 3 additions, 1 deletionproject/MimaExcludes.scala
Loading
Please register or sign in to comment