Add a log4j compile dependency to fix build in IntelliJ

Also rename parent project to spark-parent (otherwise it shows up as
"parent" in IntelliJ, which is very confusing).

Close the reader in HadoopRDD as soon as iteration end.

Fix broken link to YARN documentation

Fix broken link in Quick Start

Send block sizes as longs in BlockManager updates

This also refactors out the common "gotNext" iterator pattern into
a shared utility class.

Adds choice of persistence level to Bagel.

Conflicts:
	core/src/test/scala/spark/scheduler/DAGSchedulerSuite.scala

Fix reference bug in Kryo serializer, add test, update version

Notify standalone deploy client of application death.

Conflicts:
	core/src/main/scala/spark/storage/BlockManagerMaster.scala
	core/src/test/scala/spark/scheduler/DAGSchedulerSuite.scala

Usually, this isn't necessary since the application will be removed
as a result of the deploy client disconnecting, but occassionally, the
standalone deploy master removes an application otherwise.

Also mark applications as FAILED instead of FINISHED when they are
killed as a result of their executors failing too many times.

Use the LocalSparkContext abstraction to properly manage clearing
spark.driver.port.

Fixed SPARK-706: Failures in block manager put leads to read task hanging.

Track assorted metrics for each task, report summaries to user at stage completion

Worker address was getting removed when removing an app.

Avoid bind failure in InputStreamsSuite

Instead of failing to bind to a fixed, already-in-use port, let the OS choose an available port for TestServer.

bump version to 0.7.1-SNAPSHOT in the subproject poms

hanging.