Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

S

spark
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Wiki
- Releases
- Model registry
- Environments
- Incidents

Snippets Groups Projects

9d3f05a9

Commit 9d3f05a9 authored 14 years ago by Matei Zaharia

Downloads
- Patches
- Plain Diff

Made shuffle algorithm pluggable and added LocalFileShuffle.

parent d9ea6d69

No related branches found

No related tags found

No related merge requests found

Changes 6

Hide whitespace changes

Inline Side-by-side

Showing

src/scala/spark/DfsShuffle.scala 19 additions, 52 deletions

src/scala/spark/DfsShuffle.scala
src/scala/spark/LocalFileShuffle.scala 152 additions, 0 deletions

src/scala/spark/LocalFileShuffle.scala
src/scala/spark/NumberedSplitRDD.scala 42 additions, 0 deletions

src/scala/spark/NumberedSplitRDD.scala
src/scala/spark/RDD.scala 6 additions, 2 deletions

src/scala/spark/RDD.scala
src/scala/spark/Shuffle.scala 15 additions, 0 deletions

src/scala/spark/Shuffle.scala
src/scala/spark/Utils.scala 3 additions, 2 deletions

src/scala/spark/Utils.scala

with 237 additions and 56 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment