- Dec 22, 2010
-
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
HttpBlockedLocalFileShuffle has also been converted to have per-reducer consumption thread. Works in local mesos, but NOT on EC2 :|
-
- Dec 21, 2010
-
-
Mosharaf Chowdhury authored
Upside: No synchronized blocking on "combiners" variable. 3x faster :) Downside: Inefficient implementation. Requiring too much temporary data. Approx. 2x increase in memory requirement :( Should be fixed at some point.
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
- Fixed config param loading bug in CustomParallelLFS
-
Mosharaf Chowdhury authored
-
- Dec 19, 2010
-
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
Conflicts: conf/java-opts src/scala/spark/BasicLocalFileShuffle.scala
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
Conflicts: conf/java-opts src/scala/spark/BlockedLocalFileShuffle.scala src/scala/spark/CustomBlockedLocalFileShuffle.scala src/scala/spark/HttpBlockedLocalFileShuffle.scala
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
Renamed BlockedLocalFileShuffle to HttpBlockedLocalFileShuffle for merging with the mos-shuffle branch.
-
- Dec 18, 2010
-
-
Mosharaf Chowdhury authored
- Clients now request for byte ranges to the server using an INDEX file.
-
- Dec 16, 2010
-
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
- Config option related to pipelining has been removed. - Summary: Basic -> Pipelining / Parallel -> NO pipelining
-
- Dec 15, 2010
-
-
Mosharaf Chowdhury authored
- Renamed some ParallelLocalFileShuffle config options for clarity.
-
Mosharaf Chowdhury authored
- Renamed parallel-pull version to ParallelLocalFileShuffle - Note that setting max-concurrent connections to 1 in ParallelLocalFileShuffle should essentially be the same as BasicLocalFileShuffle
-
- Dec 07, 2010
-
-
Mosharaf Chowdhury authored
-
- Dec 04, 2010
-
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
Removed an unnecessary byte array in the middle. Probabaly will have to bring it back if we do block level data movement.
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
-
- Dec 03, 2010
-
-
Mosharaf Chowdhury authored
-
- Dec 02, 2010
-
-
Mosharaf Chowdhury authored
-
Mosharaf Chowdhury authored
Enabling/disabling HTTP pipelining is a config option now. Performance tradeoffs are not obvious yet.
-
- Nov 28, 2010
-
-
Mosharaf Chowdhury authored
- Added GroupByTest.scala for benchmarking.
-
- Nov 13, 2010
-
-
Matei Zaharia authored
-
- Nov 12, 2010
-
-
Matei Zaharia authored
-