Skip to content
Snippets Groups Projects
Commit ccf48388 authored by Matei Zaharia's avatar Matei Zaharia
Browse files

Lowered default number of splits for files

parent c8eb8b2b
No related branches found
No related tags found
No related merge requests found
......@@ -257,7 +257,7 @@ extends Logging {
def defaultParallelism: Int = scheduler.defaultParallelism
// Default min number of splits for Hadoop RDDs when not given by user
def defaultMinSplits: Int = Math.min(defaultParallelism, 4)
def defaultMinSplits: Int = Math.min(defaultParallelism, 2)
private var nextShuffleId = new AtomicInteger(0)
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment