Rsync root directory in EC2 script

Size estimator changes for dev

update the results to match the new estimates

oops setting to get deterministic results

setting. This is useful to get a deterministic test case

according to architecture and also aligns objects and arrays when computing
instance sizes. Verified using Eclipse Memory Analysis Tool (MAT)

ConnectionManager.

It's still not good because each Future ends up waiting on a lock, but
it seems to work better than Scala Actors, and more importantly it
allows us to use onComplete and other listeners on futures.

Use JavaConversion to get a scala iterator

Detect non-zero exit status from PipedRDD process

Avoid a copy in ShuffleMapTask 

block manager.

Standalone cluster scripts

Fix test checkpoint to reuse spark context defined in the class

This is because we pull out such a large sample (10x the number of
partitions) that we should expect pretty good balance. The tests are
also deterministic so there's no worry about them failing irreproducibly.

RangePartitioner to make it pass. It turns out that the first partition
was always kind of small due to how we picked partition boundaries.

Logging Throwables in logInfo and logDebug instead of swallowing them.

Conflicts:

	core/src/main/scala/spark/Logging.scala

Conflicts:
	project/SparkBuild.scala