Skip to content
Snippets Groups Projects
  1. Feb 10, 2012
  2. Feb 06, 2012
  3. Jan 31, 2012
  4. Jan 30, 2012
  5. Jan 26, 2012
  6. Jan 13, 2012
  7. Jan 09, 2012
    • Edison Tung's avatar
      Fixed bugs · 1ecc221f
      Edison Tung authored
      I've fixed the bugs detailed in the diff. One of the bugs was already
      fixed on the local file (forgot to commit).
      1ecc221f
  8. Jan 05, 2012
  9. Dec 15, 2011
  10. Dec 14, 2011
  11. Dec 02, 2011
  12. Dec 01, 2011
  13. Nov 30, 2011
  14. Nov 21, 2011
    • Edison Tung's avatar
      added takeSamples method · a3bc012a
      Edison Tung authored
      takeSamples method takes a specified number of samples from the RDD and
      outputs it in an array.
      a3bc012a
    • Edison Tung's avatar
      Added KMeans examples · 3b9d9de5
      Edison Tung authored
      LocalKMeans runs locally with a randomly generated dataset.
      SparkLocalKMeans takes an input file and runs KMeans on it.
      3b9d9de5
  15. Nov 13, 2011
    • Ankur Dave's avatar
      Deduplicate exceptions when printing them · ad4ebff4
      Ankur Dave authored
      The first time they appear, exceptions are printed in full, including
      a stack trace. After that, they are printed in abbreviated form. They
      are periodically reprinted in full; the reprint interval defaults to 5
      seconds and is configurable using the property
      spark.logging.exceptionPrintInterval.
      ad4ebff4
    • Ankur Dave's avatar
      Report errors in tasks to the driver via a Mesos status update · 35b6358a
      Ankur Dave authored
      When a task throws an exception, the Spark executor previously just
      logged it to a local file on the slave and exited. This commit causes
      Spark to also report the exception back to the driver using a Mesos
      status update, so the user doesn't have to look through a log file on
      the slave.
      
      Here's what the reporting currently looks like:
      
          # ./run spark.examples.ExceptionHandlingTest master@203.0.113.1:5050
          [...]
          11/10/26 21:04:13 INFO spark.SimpleJob: Lost TID 1 (task 0:1)
          11/10/26 21:04:13 INFO spark.SimpleJob: Loss was due to java.lang.Exception: Testing exception handling
          [...]
          11/10/26 21:04:16 INFO spark.SparkContext: Job finished in 5.988547328 s
      35b6358a
  16. Nov 09, 2011
  17. Nov 08, 2011
  18. Nov 07, 2011
Loading