Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

S

spark
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Wiki
- Releases
- Model registry
- Environments
- Incidents

Snippets Groups Projects

d6e6abec

Commit d6e6abec authored 12 years ago by Matei Zaharia

Downloads
- Plain Diff

Merge pull request #459 from stephenh/bettersplits

Change defaultPartitioner to use upstream split size.

parents fb762505 c44ccf28

No related branches found

No related tags found

No related merge requests found

Changes 9

Hide whitespace changes

Inline Side-by-side

Showing

core/src/main/scala/spark/PairRDDFunctions.scala 8 additions, 17 deletions

core/src/main/scala/spark/PairRDDFunctions.scala
core/src/main/scala/spark/Partitioner.scala 32 additions, 0 deletions

core/src/main/scala/spark/Partitioner.scala
core/src/main/scala/spark/RDD.scala 13 additions, 5 deletions

core/src/main/scala/spark/RDD.scala
core/src/main/scala/spark/SparkContext.scala 1 addition, 1 deletion

core/src/main/scala/spark/SparkContext.scala
core/src/main/scala/spark/api/java/JavaPairRDD.scala 10 additions, 9 deletions

core/src/main/scala/spark/api/java/JavaPairRDD.scala
core/src/main/scala/spark/scheduler/cluster/StandaloneSchedulerBackend.scala 2 additions, 1 deletion

.../spark/scheduler/cluster/StandaloneSchedulerBackend.scala
core/src/test/scala/spark/PartitioningSuite.scala 4 additions, 4 deletions

core/src/test/scala/spark/PartitioningSuite.scala
core/src/test/scala/spark/ShuffleSuite.scala 20 additions, 1 deletion

core/src/test/scala/spark/ShuffleSuite.scala
docs/tuning.md 4 additions, 4 deletions

docs/tuning.md

with 94 additions and 42 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment