Skip to content
Snippets Groups Projects
Commit 59003d38 authored by Stephen Haberman's avatar Stephen Haberman
Browse files

Use a set since shuffle could change order.

parent 6471bfec
No related branches found
No related tags found
No related merge requests found
......@@ -179,7 +179,7 @@ class RDDSuite extends FunSuite with SharedSparkContext {
// when shuffling, we can increase the number of partitions
val coalesced6 = data.coalesce(20, shuffle = true)
assert(coalesced6.partitions.size === 20)
assert(coalesced6.collect().toList === (1 to 10).toList)
assert(coalesced6.collect().toSet === (1 to 10).toSet)
}
test("coalesced RDDs with locality") {
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment