other issues

Conflicts:
	run2.cmd

Fixed a 404 in 'Tuning Spark' -- missing '.html'

add as many fetch requests as we can, subject to maxBytesInFlight

SPARK-678: Adding an example with an OLAP roll-up

Add RDD.coalesce, clean up some RDDs, other misc.

Add commutative requirement for 'reduce' to Python docstring.

Change docs on 'reduce' since the merging of local reduces no longer pre...

Conflicts:
	core/src/main/scala/spark/RDD.scala

SPARK-685 Adding IPYTHON environment variable support for launching pyspark using ...

ordering, so the reduce function must also be commutative.

Also made sure clearDependencies() was calling super, to ensure
the getSplits/getDependencies vars in the RDD base class get
cleaned up.

Also rename r->rdd and remove unneeded extra type info.

Inline mergePair to look more like the narrow dep branch.

Handle Terminated to avoid endless DeathPactExceptions.

Conflicts:
	core/src/main/scala/spark/deploy/worker/Worker.scala

Increase DriverSuite timeout.

Credit to Roland Kuhn, Akka's tech lead, for pointing out this
various obvious fix, but StandaloneExecutorBackend.preStart's
catch block would never (ever) get hit, because all of the
operation's in preStart are async.

So, the System.exit in the catch block was skipped, and instead
Akka was sending Terminated messages which, since we didn't
handle, it turned into DeathPactException, which started
a postRestart/preStart infinite loop.

No functionality changes, I think this is just more consistent
given mergePair isn't called multiple times/recursive.

Also added a comment to explain the usual case of having two parent RDDs.

Streaming constructor which takes JavaSparkContext

It's sometimes helpful to directly pass a JavaSparkContext,
and take advantage of the various constructors available for that.

Fix exit status in PySpark unit tests; fix/optimize PySpark's RDD.take()

Add spark.executor.memory to differentiate executor memory from spark-shell

RDDInfo available from SparkContext

Once we find a split with no block, we don't have to look for more.