Commits · 3fad5e580f6ca8a7ade6d566f7cc51f975c60e93 · cs525-sp18-g07 / spark

Nov 04, 2011
- Fix Scala version requirement in README · 3fad5e58
  Matei Zaharia authored 13 years ago
  
  3fad5e58
Nov 02, 2011
- Make parallelize() work efficiently for ranges of Long, Double, etc · c2b7fd68
  Matei Zaharia authored 13 years ago
  
  (splitting them into sub-ranges). Fixes #87.
  c2b7fd68
Nov 01, 2011
- K-means example · d4c8e69d
  Matei Zaharia authored 13 years ago
  
  d4c8e69d
Oct 30, 2011
- Update Spark to work with the latest Mesos API · 157279e9
  Matei Zaharia authored 13 years ago
  
  157279e9
Oct 17, 2011

root authored 13 years ago

- Executor should initialize logging properly
- groupByKey should allow custom partitioner

3a0e6c43

Switched Jetty to version 7.5 because 8.0 was causing a conflict with the... · 49505a0b
root authored 13 years ago
```
Switched Jetty to version 7.5 because 8.0 was causing a conflict with the log4j and Jetty libraries in Hadoop.
```
49505a0b

Oct 13, 2011
- Merge branch 'ankur-master' · 62aa8200
  root authored 13 years ago
  
  62aa8200
Oct 09, 2011
- Implement standalone WikipediaPageRank with custom serializer · ab3889f6
  Ankur Dave authored 13 years ago
  
  ab3889f6
- Update WikipediaPageRank to reflect Bagel API changes · cbdc01ee
  Ankur Dave authored 13 years ago
  
  cbdc01ee
- Remove ShortestPath for now · 6d707f6b
  Ankur Dave authored 13 years ago
  
  6d707f6b
- Simplify and genericize type parameters in Bagel · 0028caf3
  Ankur Dave authored 13 years ago
  
  0028caf3
- Implement PairRDDFunctions.partitionBy · 2d7057bf
  Ankur Dave authored 13 years ago
  
  2d7057bf
- Fix PairRDDFunctions.groupWith partitioning · 06637cb6
  Ankur Dave authored 13 years ago
  
  This commit fixes a bug in groupWith that was causing it to destroy partitioning information. It replaces a call to map with a call to mapValues, which preserves partitioning.
  06637cb6
- Add custom partitioner support to PairRDDFunctions.combineByKey · 2911a783
  Ankur Dave authored 13 years ago
  
  2911a783
- Use BufferedOutputStream in ShuffleMapTask · 6c6e47e3
  Ankur Dave authored 13 years ago
  
  6c6e47e3
Sep 30, 2011
- Merge pull request #83 from ijuma/sbt-0.11 · 6483b413
  Matei Zaharia authored 13 years ago
  
  Upgrade to SBT 0.11.0
  6483b413
Sep 27, 2011
- Upgrade to sbt-idea 0.11.0 final. · d76c0fc7
  Ismael Juma authored 13 years ago
  
  d76c0fc7
Sep 26, 2011
- Add workaround for bug in SBT (issue #206). · 7e92ef9d
  Ismael Juma authored 13 years ago
  
  7e92ef9d
- Set SCALA_VERSION to 2.9.1 (from 2.9.1.final) to match expectation of SBT 0.11.0 · 4019305a
  Ismael Juma authored 13 years ago
  
  4019305a
- Include "spark-" prefix in project name (used when artifact is published). · 3562db63
  Ismael Juma authored 13 years ago
  
  3562db63
- Upgrade compress-lzf to 0.8.4. · 28b5d5a2
  Ismael Juma authored 13 years ago
  
  28b5d5a2
- Upgrade Jetty to 8.0.1. · 315e55fd
  Ismael Juma authored 13 years ago
  
  315e55fd
- Use scalatest and scalacheck compiled against Scala 2.9.1. · ee980439
  Ismael Juma authored 13 years ago
  
  ee980439
- Use new layout for plugins definitions (recommended for SBT 0.11) · bd774eb2
  Ismael Juma authored 13 years ago
  
  bd774eb2
- Upgrade to SBT 0.11.0. · e39edcce
  Ismael Juma authored 13 years ago
  
  e39edcce
Aug 31, 2011

Merge pull request #82 from ijuma/scala-2.9.1 · a362985f
Matei Zaharia authored 13 years ago
```
Upgrade to Scala 2.9.1.
```
a362985f

Upgrade to Scala 2.9.1. · 483f724d

Ismael Juma authored 13 years ago

Interestingly, the version in Maven is 2.9.1, but SBT outputs file to the 2.9.1.final
directory inside target.

A couple of small changes in SparkIMain were also required.

All tests pass and ./spark-shell launches successfully.

483f724d

Aug 30, 2011
- Added a jarOfObject method to get the JAR of the class that an object · 10697402
  Matei Zaharia authored 13 years ago
  
  belongs to, which seems like a more common case.
  10697402
- Removed a debugging line · 0c965a10
  Matei Zaharia authored 13 years ago
  
  0c965a10
- Added a convenience method for getting the JAR file that loaded a class · 0aa23bf1
  Matei Zaharia authored 13 years ago
  
  (useful for jobs to pass their own JAR files to SparkContext).
  0aa23bf1
- Only include JAR files in lib in the unmanaged classpath. · 9b7215d7
  Matei Zaharia authored 13 years ago
  
  9b7215d7
Aug 29, 2011
- Use the new SBT 0.10 assembly plugin instead of the DepJar code we had. · 4cc5e51e
  Matei Zaharia authored 13 years ago
  
  4cc5e51e
Aug 27, 2011
- Made a log message slightly less ugly · a161f006
  Matei Zaharia authored 13 years ago
  
  a161f006
Aug 10, 2011
- New mesos.jar · 3759bcd0
  Matei Zaharia authored 13 years ago
  
  3759bcd0
Aug 02, 2011
- Minor fix: can use >= when checking memory · c22043f1
  Matei Zaharia authored 13 years ago
  
  c22043f1
- Merge pull request #77 from ijuma/issue69 · f6c8c2a3
  Matei Zaharia authored 13 years ago
  
  Enable -optimize in the build
  f6c8c2a3
- Merge pull request #76 from ijuma/deprecations-scala-2.9 · cfc6000e
  Matei Zaharia authored 13 years ago
  
  Fix code not to use code deprecated in Scala 2.9
  cfc6000e
- Fix issue #69: Enable -optimize in the build · 2b6fd319
  Ismael Juma authored 13 years ago
  
  2b6fd319
- Add note about why we can't enable -deprecation switch. · 59c7131d
  Ismael Juma authored 13 years ago
  
  59c7131d
- Use process instead of main as the latter is deprecated. · 065043a1
  Ismael Juma authored 13 years ago
  
  065043a1