- Oct 15, 2010
-
-
Matei Zaharia authored
directory by setting SPARK_HOME and locating the executor relative to that. Entries on SPARK_CLASSPATH and SPARK_LIBRARY_PATH are also passed along to worker nodes.
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
- Use collect instead of toArray - Disable the "running on Mesos" test when MESOS_HOME is not set
-
Matei Zaharia authored
CPU and memory requested per task.
-
- Oct 07, 2010
-
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
for each split. This replaces the previous method of calling split.toString, which would produce different results for the same split each time it is deserialized (because the default implementation returns the Java object's address).
-
Matei Zaharia authored
-
Justin Ma authored
-
Justin Ma authored
-
Justin Ma authored
ensure that the proper keys will be generated when they cached.
-
- Oct 05, 2010
-
-
Matei Zaharia authored
-
- Oct 04, 2010
-
-
Matei Zaharia authored
-
- Oct 03, 2010
-
-
Matei Zaharia authored
-
Matei Zaharia authored
-
root authored
caching was not working because Split objects did not have a consistent toString value
- Sep 29, 2010
-
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
- Don't include trailing $'s in class names of Scala objects - Report errors using logError instead of printStackTrace
-
Matei Zaharia authored
-
Matei Zaharia authored
Changed printlns to log statements and fixed a bug in run that was causing it to fail on a Mesos cluster
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
-
- Sep 28, 2010
-
-
Matei Zaharia authored
HTTP server instead of a shared (NFS) file system.
-
Justin Ma authored
-
- Sep 25, 2010
-
-
Justin Ma authored
-
- Sep 13, 2010
-
-
Justin Ma authored
-
- Sep 12, 2010
-
-
Justin Ma authored
Added fork()/join() operations for SparkContext, as well as corresponding changes to MesosScheduler to support multiple ParallelOperations.
-
- Sep 07, 2010
-
-
Justin Ma authored
-
- Sep 01, 2010
-
-
Justin Ma authored
-