Return size estimation, cache usage, and cache capacity from slave nodes to CacheTracker

to be serialized in closure serialization. This can significantly reduce
the task setup time in Shark when the query involves a large number of
(Hive) partitions.

it was pretty ugly that put() should return -1 for failures.

trackor. This is essential for building a dashboard to see the status of
caches on all slaves.

from the same dataset.

Force serialize/deserialize task results in local execution mode.

End task instead of just exiting in LocalScheduler for tasks that throw exceptions

would throw an exception for local tasks).

Added the ability to set environmental variables in piped rdd.

Added an option (spark.closure.serializer) to specify the serializer for closures.

tasks.

closures. This enables using Kryo as the closure serializer.

Report entry dropping in BoundedMemoryCache

BoundedMemoryCache, in case the JVM was not started with its initial
heap size equaling its maximum one (-Xms == -Xmx).

assembled jar for Shark.

number of partitions we ask to partition it into. Also, removed a test
that was taking way too long to run.

Changed HadoopRDD to get key and value containers from the RecordReader instead of through reflection

wait() with a timeout of 0 on a Java object means "wait forever".

Adding sorting to RDDs