-
- Downloads
[SPARK-5064][GraphX] Add numEdges upperbound validation for R-MAT graph...
[SPARK-5064][GraphX] Add numEdges upperbound validation for R-MAT graph generator to prevent infinite loop I looked into GraphGenerators#chooseCell, and found that chooseCell can't generate more edges than pow(2, (2 * (log2(numVertices)-1))) to make a Power-law graph. (Ex. numVertices:4 upperbound:4, numVertices:8 upperbound:16, numVertices:16 upperbound:64) If we request more edges over the upperbound, rmatGraph fall into infinite loop. So, how about adding an argument validation? Author: Kenji Kikushima <kikushima.kenji@lab.ntt.co.jp> Closes #3950 from kj-ki/SPARK-5064 and squashes the following commits: 4ee18c7 [Ankur Dave] Reword error message and add unit test d760bc7 [Kenji Kikushima] Add numEdges upperbound validation for R-MAT graph generator to prevent infinite loop.
Showing
- graphx/src/main/scala/org/apache/spark/graphx/util/GraphGenerators.scala 6 additions, 0 deletions.../scala/org/apache/spark/graphx/util/GraphGenerators.scala
- graphx/src/test/scala/org/apache/spark/graphx/util/GraphGeneratorsSuite.scala 10 additions, 0 deletions...a/org/apache/spark/graphx/util/GraphGeneratorsSuite.scala
Please register or sign in to comment