- Oct 16, 2010
-
-
Matei Zaharia authored
are used to create an initial copy of each config file if the user does not have one. This way, users won't accidentally commit their changes to config files to git.
-
Matei Zaharia authored
-
Matei Zaharia authored
use this. Closes #12.
-
Matei Zaharia authored
-
Matei Zaharia authored
Simplified UnionRDD slightly and added a SparkContext.union method for efficiently union-ing a large number of RDDs
-
Matei Zaharia authored
optional constructor parameter, so that the scheduler is guaranteed that a Spark home has been set when it first builds its executor arg.
-
Matei Zaharia authored
SparkContext and have the master node serve those to workers.
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
method for setting it programatically.
-
Matei Zaharia authored
-
- Oct 15, 2010
-
-
Matei Zaharia authored
directory by setting SPARK_HOME and locating the executor relative to that. Entries on SPARK_CLASSPATH and SPARK_LIBRARY_PATH are also passed along to worker nodes.
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
- Use collect instead of toArray - Disable the "running on Mesos" test when MESOS_HOME is not set
-
Matei Zaharia authored
CPU and memory requested per task.
-
- Oct 07, 2010
-
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
for each split. This replaces the previous method of calling split.toString, which would produce different results for the same split each time it is deserialized (because the default implementation returns the Java object's address).
-
Matei Zaharia authored
-
Justin Ma authored
-
Justin Ma authored
-
Justin Ma authored
ensure that the proper keys will be generated when they cached.
-
- Oct 05, 2010
-
-
Matei Zaharia authored
-
- Oct 04, 2010
-
-
Matei Zaharia authored
-
- Oct 03, 2010
-
-
Matei Zaharia authored
-
Matei Zaharia authored
-
root authored
caching was not working because Split objects did not have a consistent toString value
- Sep 29, 2010
-
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
-
Matei Zaharia authored
- Don't include trailing $'s in class names of Scala objects - Report errors using logError instead of printStackTrace
-
Matei Zaharia authored
-