Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

S

spark
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Wiki
- Releases
- Model registry
- Environments
- Incidents

Snippets Groups Projects

4032beba

Commit 4032beba authored 12 years ago by Matei Zaharia

Downloads
- Plain Diff

Merge pull request #521 from stephenh/earlyclose

Close the reader in HadoopRDD as soon as iteration end.

parents 3c97276a e7f1a69c

No related branches found

No related tags found

No related merge requests found

Changes 5

Hide whitespace changes

Inline Side-by-side

Showing

core/src/main/scala/spark/rdd/HadoopRDD.scala 9 additions, 24 deletions

core/src/main/scala/spark/rdd/HadoopRDD.scala
core/src/main/scala/spark/serializer/Serializer.scala 5 additions, 27 deletions

core/src/main/scala/spark/serializer/Serializer.scala
core/src/main/scala/spark/util/NextIterator.scala 71 additions, 0 deletions

core/src/main/scala/spark/util/NextIterator.scala
core/src/test/scala/spark/util/NextIteratorSuite.scala 68 additions, 0 deletions

core/src/test/scala/spark/util/NextIteratorSuite.scala
streaming/src/main/scala/spark/streaming/dstream/SocketInputDStream.scala 9 additions, 35 deletions

...in/scala/spark/streaming/dstream/SocketInputDStream.scala

with 162 additions and 86 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment