Commits · 23f4622affc25685bb74ce09ed56ef3515551d17 · cs525-sp18-g07 / spark

Aug 18, 2013
- Remove redundant dependencies from POMs · 23f4622a
  Jey Kottalam authored 11 years ago
  
  23f4622a
- Fix Maven build with Hadoop 0.23.9 · bdd861c6
  Jey Kottalam authored 11 years ago
  
  bdd861c6
- Don't assume spark-examples JAR always exists · 47a7c433
  Jey Kottalam authored 11 years ago
  
  47a7c433
- Make YARN POM file valid · 44000b10
  Jey Kottalam authored 11 years ago
  
  44000b10
Aug 16, 2013
- Rename YARN build flag to SPARK_WITH_YARN · 67b59360
  Jey Kottalam authored 11 years ago
  
  67b59360
- Fix SBT build under Hadoop 0.23.x · b1d99744
  Jey Kottalam authored 11 years ago
  
  b1d99744
- Updates to repl and example POMs to match SBT build · c1e547bb
  Jey Kottalam authored 11 years ago
  
  c1e547bb
- Maven build now also works with YARN · ad580b94
  Jey Kottalam authored 11 years ago
  
  ad580b94
- Forgot to remove a few references to ${classifier} · 741ecd56
  Jey Kottalam authored 11 years ago
  
  741ecd56
- Don't mark hadoop-client as 'provided' · 9dd15fe7
  Jey Kottalam authored 11 years ago
  
  9dd15fe7
- Maven build now works with CDH hadoop-2.0.0-mr1 · 11b42a84
  Jey Kottalam authored 11 years ago
  
  11b42a84
- Initial changes to make Maven build agnostic of hadoop version · 353fab24
  Jey Kottalam authored 11 years ago
  
  353fab24
- Fix repl/assembly when YARN enabled · 8add2d7a
  Jey Kottalam authored 11 years ago
  
  8add2d7a
- Allow make-distribution.sh to specify Hadoop version used · 3f98eff6
  Jey Kottalam authored 11 years ago
  
  3f98eff6
Aug 15, 2013
- Update default version of Hadoop to 1.2.1 · a0f08484
  Jey Kottalam authored 11 years ago
  
  a0f08484
- Rename HadoopWriter to SparkHadoopWriter since it's outside of our package · a06a9d5c
  Jey Kottalam authored 11 years ago
  
  a06a9d5c
- Fix newTaskAttemptID to work under YARN · 8f979ede
  Jey Kottalam authored 11 years ago
  
  8f979ede
- update YARN docs · 14b6bcdf
  Jey Kottalam authored 11 years ago
  
  14b6bcdf
- YARN ApplicationMaster shouldn't wait forever · 8bb0bd11
  Jey Kottalam authored 11 years ago
  
  8bb0bd11
- re-enable YARN support · e2d7656c
  Jey Kottalam authored 11 years ago
  
  e2d7656c
- SparkEnv isn't available this early, and not needed anyway · bd0bab47
  Jey Kottalam authored 11 years ago
  
  bd0bab47
- make SparkHadoopUtil a member of SparkEnv · 4f43fd79
  Jey Kottalam authored 11 years ago
  
  4f43fd79
- rename HadoopMapRedUtil => SparkHadoopMapRedUtil, HadoopMapReduceUtil => SparkHadoopMapReduceUtil · 43ebcb84
  Jey Kottalam authored 11 years ago
  
  43ebcb84
- yarn support · cb4ef192
  Jey Kottalam authored 11 years ago
  
  cb4ef192
- add comment · 8b1c1520
  Jey Kottalam authored 11 years ago
  
  8b1c1520
- remove hadoop-yarn's org/apache/... · 5d0785b4
  Jey Kottalam authored 11 years ago
  
  5d0785b4
- yarn sbt · 273b499b
  Jey Kottalam authored 11 years ago
  
  273b499b
- dynamically detect hadoop version · 69c3bbf6
  Jey Kottalam authored 11 years ago
  
  69c3bbf6
- remove core/src/hadoop{1,2} dirs · f67b94ad
  Jey Kottalam authored 11 years ago
  
  f67b94ad
- move yarn to its own directory · b877e20a
  Jey Kottalam authored 11 years ago
  
  b877e20a
- Merge pull request #829 from JoshRosen/pyspark-unit-tests-python-2.6 · 28369ff7
  Matei Zaharia authored 11 years ago
  
  Fix PySpark unit tests on Python 2.6
  28369ff7
- Merge pull request #833 from rxin/ui · 1a13460c
  Reynold Xin authored 11 years ago
  
  Various UI improvements.
  1a13460c
- More minor UI changes including code review feedback. · 1a51deae
  Reynold Xin authored 11 years ago
  
  1a51deae
- Various UI improvements. · 2d2a556b
  Reynold Xin authored 11 years ago
  
  2d2a556b
Aug 14, 2013
- Merge pull request #831 from rxin/scheduler · 044a088c
  Reynold Xin authored 11 years ago
  
  A few small scheduler / job description changes.
  044a088c
- Renamed setCurrentJobDescription to setJobDescription. · 290e3e6e
  Reynold Xin authored 11 years ago
  
  290e3e6e
- A few small scheduler / job description changes. · 3886b549
  Reynold Xin authored 11 years ago
  
  1. Renamed SparkContext.addLocalProperty to setLocalProperty. And allow this function to unset a property. 2. Renamed SparkContext.setDescription to setCurrentJobDescription. 3. Throw an exception if the fair scheduler allocation file is invalid.
  3886b549
- Merge pull request #822 from pwendell/ui-features · 839f2d4f
  Matei Zaharia authored 11 years ago
  
  Adding GC Stats to TaskMetrics (and three small fixes)
  839f2d4f
- Fix PySpark unit tests on Python 2.6. · 7a9abb9d
  Josh Rosen authored 11 years ago
  
  7a9abb9d
- Style cleanup based on Matei feedback · 04ad78b0
  Patrick Wendell authored 11 years ago
  
  04ad78b0