Skip to content
Snippets Groups Projects
Commit 4f1dcd3d authored by WeichenXu's avatar WeichenXu Committed by Reynold Xin
Browse files

[SPARK-18051][SPARK CORE] fix bug of custom PartitionCoalescer causing serialization exception

## What changes were proposed in this pull request?

add a require check in `CoalescedRDD` to make sure the passed in `partitionCoalescer` to be `serializable`.
and update the document for api `RDD.coalesce`

## How was this patch tested?

Manual.(test code in jira [SPARK-18051])

Author: WeichenXu <WeichenXu123@outlook.com>

Closes #15587 from WeichenXu123/fix_coalescer_bug.
parent 5fa9f879
No related branches found
No related tags found
No related merge requests found
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment