-
- Downloads
[SPARK-12655][GRAPHX] GraphX does not unpersist RDDs
Some VertexRDD and EdgeRDD are created during the intermediate step of g.connectedComponents() but unnecessarily left cached after the method is done. The fix is to unpersist these RDDs once they are no longer in use. A test case is added to confirm the fix for the reported bug. Author: Jason Lee <cjlee@us.ibm.com> Closes #10713 from jasoncl/SPARK-12655.
Showing
- graphx/src/main/scala/org/apache/spark/graphx/Pregel.scala 1 addition, 1 deletiongraphx/src/main/scala/org/apache/spark/graphx/Pregel.scala
- graphx/src/main/scala/org/apache/spark/graphx/lib/ConnectedComponents.scala 3 additions, 1 deletion...ala/org/apache/spark/graphx/lib/ConnectedComponents.scala
- graphx/src/test/scala/org/apache/spark/graphx/GraphSuite.scala 16 additions, 0 deletions...x/src/test/scala/org/apache/spark/graphx/GraphSuite.scala
Please register or sign in to comment