Commits · c5e2810dc75ac0bae94b1e50ff8c0d198d185b52 · cs525-sp18-g07 / spark

Jul 26, 2012
- Add persist(), splits(), glom(), and mapPartitions() to Java API. · c5e2810d
  Josh Rosen authored 12 years ago
  
  c5e2810d
Jul 25, 2012
- Remove StringOps.split() from Java WordCount. · 2a60c998
  Josh Rosen authored 12 years ago
  
  2a60c998
Jul 24, 2012

Minor cleanup and optimizations in Java API. · 6a78e882

Josh Rosen authored 12 years ago

- Add override keywords.
- Cache RDDs and counts in TC example.
- Clean up JavaRDDLike's abstract methods.

6a78e882

Jul 22, 2012
- Add type annotations to Java API methods. · 042dcbde
  Josh Rosen authored 12 years ago
  
  Add missing Scala Map to java.util.Map conversions.
  042dcbde
- Use mapValues() in JavaPairRDD.cogroupResultToJava(). · e23938c3
  Josh Rosen authored 12 years ago
  
  e23938c3
- Improve Java API examples · 460da878
  Josh Rosen authored 12 years ago
  
  - Replace JavaLR example with JavaHdfsLR example. - Use anonymous classes in JavaWordCount; add options. - Remove @Override annotations.
  460da878
Jul 18, 2012

Add Java API · 01dce3f5

Josh Rosen authored 12 years ago

Add distinct() method to RDD.

Fix bug in DoubleRDDFunctions.

01dce3f5

Jul 12, 2012
- Allow null keys in Spark's reduce and group by · 628bb5ca
  Matei Zaharia authored 12 years ago
  
  628bb5ca
- Fixes to coarse-grained Mesos scheduler in dealing with failed nodes · e2a67a80
  Matei Zaharia authored 12 years ago
  
  e2a67a80
Jul 11, 2012
- Formatting · be622cf8
  Matei Zaharia authored 12 years ago
  
  be622cf8
- Added more methods for loading/saving with new Hadoop API · e8ae77df
  Matei Zaharia authored 12 years ago
  
  e8ae77df
Jul 08, 2012
- More work to allow Spark to run on the standalone deploy cluster. · 0a472840
  Matei Zaharia authored 12 years ago
  
  0a472840
- Added back coarse-grained Mesos scheduler based on StandaloneScheduler. · 1aa63f77
  Matei Zaharia authored 12 years ago
  
  1aa63f77
Jul 06, 2012
- More work on standalone scheduler · c5cc10cd
  Matei Zaharia authored 12 years ago
  
  c5cc10cd
- Further refactoring, and start of a standalone scheduler backend · 909b3252
  Matei Zaharia authored 12 years ago
  
  909b3252
- Miscellaneous bug fixes · 4e2fe0bd
  Matei Zaharia authored 12 years ago
  
  4e2fe0bd
- Some refactoring to make cluster scheduler pluggable. · e72afdb8
  Matei Zaharia authored 12 years ago
  
  e72afdb8
Jul 01, 2012
- Further updates to run processes on cluster. · 5d1a887b
  Matei Zaharia authored 12 years ago
  
  5d1a887b
- More work on standalone deploy system. · 51c46eac
  Matei Zaharia authored 12 years ago
  
  51c46eac
Jun 30, 2012
- Detect connection and disconnection of slaves · a6eb9fda
  Matei Zaharia authored 12 years ago
  
  a6eb9fda
- More work on deploy code (adding Worker class) · 408b5a13
  Matei Zaharia authored 12 years ago
  
  408b5a13
- Initial framework to get a master and web UI up. · 2fb6e7d7
  Matei Zaharia authored 12 years ago
  
  2fb6e7d7
Jun 29, 2012
- Various code style fixes, mostly from IntelliJ IDEA · c53670b9
  Matei Zaharia authored 12 years ago
  
  c53670b9
- Scalacheck groupId has changed... · 697b0bee
  rrmckinley authored 12 years ago
  
  Scalacheck groupId has changed https://github.com/rickynils/scalacheck/issues/24. Necessary to build with scalaVersion 2.9.2. Works with 2.9.1 too.
  697b0bee
- Increase the default wait time for EC2 clusters to 2 minutes. · 8a5bd4e7
  Matei Zaharia authored 12 years ago
  
  8a5bd4e7
- Fixes to CoarseMesosScheduler · c6be4ffb
  Matei Zaharia authored 12 years ago
  
  c6be4ffb
- Allow binding to a free port and change Akka logging to use SLF4J. Also · 3a58efa5
  Matei Zaharia authored 12 years ago
  
  fixes various bugs in the previous code when running on Mesos.
  3a58efa5
- Ignore some IDE files · 14bfad11
  Matei Zaharia authored 12 years ago
  
  14bfad11
- Upgraded to Akka 2 and fixed test execution (which was still parallel · 39201899
  Matei Zaharia authored 12 years ago
  
  across projects).
  39201899
Jun 22, 2012
- Fixed issues duplicate class issues in sbt assembly. · ede615d7
  Tathagata Das authored 12 years ago
  
  ede615d7
Jun 20, 2012
- Various fixes when running on Mesos · 6ad3e1f1
  root authored 12 years ago
  
  6ad3e1f1
Jun 17, 2012
- Added testcase for ByteBufferInputStream bugs. · e896a505
  Tathagata Das authored 12 years ago
  
  e896a505
- Update SBT and SBT-Eclipse version · 3e0396c9
  Matei Zaharia authored 12 years ago
  
  3e0396c9
- Fixed nasty corner case bug in ByteBufferInputStream. Could not add a test... · 40536e36
  Tathagata Das authored 12 years ago
  
  Fixed nasty corner case bug in ByteBufferInputStream. Could not add a test case for this as I could not figure out how to deterministically reproduce the bug in a short testcase.
  40536e36
- Various fixes to get unit tests running. In particular, shut down · 2893b305
  Matei Zaharia authored 12 years ago
  
  ConnectionManager and DAGScheduler properly, plus a fix to LocalScheduler that was not merged in from 0.5 and was actually caught by one of the tests.
  2893b305
Jun 16, 2012
- Update version number for dev branch · 08579ffa
  Matei Zaharia authored 12 years ago
  
  08579ffa
- Fixed HttpBroadcast to work with this branch's Serializer. · b3eeac55
  Matei Zaharia authored 12 years ago
  
  b3eeac55
- Merge branch 'master' into dev · f58da616
  Matei Zaharia authored 12 years ago
  
  f58da616
- Merge branch 'dev' of github.com:mesos/spark into dev · b5cf47cd
  Matei Zaharia authored 12 years ago
  
  b5cf47cd
Jun 13, 2012
- Changed version in master branch to 0.5.1-SNAPSHOT for further · 4449eb97
  Matei Zaharia authored 12 years ago
  
  development.
  4449eb97