Skip to content
Snippets Groups Projects
Commit 1bcd09e0 authored by Andy Konwinski's avatar Andy Konwinski
Browse files

Merge remote-tracking branch 'public-spark/dev' into doc

parents 35adccd0 4b8b0d5c
No related branches found
No related tags found
No related merge requests found
...@@ -188,7 +188,7 @@ class ShuffleMapTask( ...@@ -188,7 +188,7 @@ class ShuffleMapTask(
// Get a scala iterator from java map // Get a scala iterator from java map
val iter: Iterator[(Any, Any)] = bucketIterators(i) val iter: Iterator[(Any, Any)] = bucketIterators(i)
// TODO: This should probably be DISK_ONLY // TODO: This should probably be DISK_ONLY
blockManager.put(blockId, iter, StorageLevel.MEMORY_ONLY, false) blockManager.put(blockId, iter, StorageLevel.DISK_ONLY, false)
} }
return SparkEnv.get.blockManager.blockManagerId return SparkEnv.get.blockManager.blockManagerId
......
...@@ -62,6 +62,7 @@ of `project/SparkBuild.scala`, then rebuilding Spark (`sbt/sbt clean compile`). ...@@ -62,6 +62,7 @@ of `project/SparkBuild.scala`, then rebuilding Spark (`sbt/sbt clean compile`).
# Other Resources # Other Resources
* [Spark Homepage](http://www.spark-project.org) * [Spark Homepage](http://www.spark-project.org)
* [AMPCamp](http://ampcamp.berkeley.edu/): All AMPCamp presentation videos are available online. Going through the videos and exercises is a great way to sharpen your Spark skills.
* [Paper describing the programming model](http://www.cs.berkeley.edu/~matei/papers/2012/nsdi_spark.pdf) * [Paper describing the programming model](http://www.cs.berkeley.edu/~matei/papers/2012/nsdi_spark.pdf)
* [Code Examples](http://spark-project.org/examples.html) (more also available in the [examples subfolder](https://github.com/mesos/spark/tree/master/examples/src/main/scala/spark/examples) of the Spark codebase) * [Code Examples](http://spark-project.org/examples.html) (more also available in the [examples subfolder](https://github.com/mesos/spark/tree/master/examples/src/main/scala/spark/examples) of the Spark codebase)
* [Mailing List](http://groups.google.com/group/spark-users) * [Mailing List](http://groups.google.com/group/spark-users)
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment