Skip to content
Snippets Groups Projects
  1. Feb 01, 2013
    • Josh Rosen's avatar
      Do not launch JavaGateways on workers (SPARK-674). · 9cc6ff9c
      Josh Rosen authored
      The problem was that the gateway was being initialized whenever the
      pyspark.context module was loaded.  The fix uses lazy initialization
      that occurs only when SparkContext instances are actually constructed.
      
      I also made the gateway and jvm variables private.
      
      This change results in ~3-4x performance improvement when running the
      PySpark unit tests.
      9cc6ff9c
  2. Jan 23, 2013
  3. Jan 22, 2013
  4. Jan 21, 2013
  5. Jan 20, 2013
  6. Jan 10, 2013
  7. Jan 03, 2013
  8. Jan 01, 2013
  9. Dec 29, 2012
  10. Dec 27, 2012
  11. Dec 26, 2012
  12. Dec 24, 2012
  13. Oct 19, 2012
  14. Aug 27, 2012
  15. Aug 21, 2012
  16. Aug 19, 2012
Loading