Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

S

spark
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Wiki
- Releases
- Model registry
- Environments
- Incidents

Snippets Groups Projects

200d248d

Commit 200d248d authored 12 years ago by Josh Rosen

Downloads
- Patches
- Plain Diff

Simplify Python worker; pipeline the map step of partitionBy().

parent 6904cb77

No related branches found

No related tags found

No related merge requests found

Changes 5

Hide whitespace changes

Inline Side-by-side

Showing

core/src/main/scala/spark/api/python/PythonRDD.scala 7 additions, 27 deletions

core/src/main/scala/spark/api/python/PythonRDD.scala
pyspark/pyspark/context.py 4 additions, 5 deletions

pyspark/pyspark/context.py
pyspark/pyspark/rdd.py 27 additions, 43 deletions

pyspark/pyspark/rdd.py
pyspark/pyspark/serializers.py 6 additions, 17 deletions

pyspark/pyspark/serializers.py
pyspark/pyspark/worker.py 15 additions, 35 deletions

pyspark/pyspark/worker.py

with 59 additions and 127 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment