Skip to content
Snippets Groups Projects
  1. Aug 26, 2016
    • Michael Gummelt's avatar
      [SPARK-16967] move mesos to module · 8e5475be
      Michael Gummelt authored
      ## What changes were proposed in this pull request?
      
      Move Mesos code into a mvn module
      
      ## How was this patch tested?
      
      unit tests
      manually submitting a client mode and cluster mode job
      spark/mesos integration test suite
      
      Author: Michael Gummelt <mgummelt@mesosphere.io>
      
      Closes #14637 from mgummelt/mesos-module.
      8e5475be
  2. May 10, 2016
    • Dongjoon Hyun's avatar
      [SPARK-15207][BUILD] Use Travis CI for Java Linter and JDK7/8 compilation test · 603c4f8e
      Dongjoon Hyun authored
      ## What changes were proposed in this pull request?
      
      Currently, Java Linter is disabled in Jenkins tests.
      
      https://github.com/apache/spark/blob/master/dev/run-tests.py#L554
      
      However, as of today, Spark has 721 java files with 97362 code (without blank/comments). It's about 1/3 of Scala.
      ```
      --------------------------------------------------------------------------------
      Language                      files          blank        comment           code
      --------------------------------------------------------------------------------
      Scala                          2353          62819         124060         318747
      Java                            721          18617          23314          97362
      ```
      
      This PR aims to take advantage of Travis CI to handle the following static analysis by adding a single file, `.travis.yml` without any additional burden on the existing servers.
      
      - Java Linter
      - JDK7/JDK8 maven compile
      
      Note that this PR does not propose to remove some of the above work items from the Jenkins. It's possible, but we need to observe the Travis CI stability for a while. The main goal of this issue is to remove committer's overhead on linter-related PRs (the original PR and the fixation PR).
      
      ## How was this patch tested?
      
      Pass the Travis CI tests. Please see the following link.
      
      https://travis-ci.org/dongjoon-hyun/spark/builds/128595350
      https://travis-ci.org/dongjoon-hyun/spark/builds/128708372
      
      Author: Dongjoon Hyun <dongjoon@apache.org>
      
      Closes #12980 from dongjoon-hyun/SPARK-15207.
      603c4f8e
  3. Aug 18, 2014
  4. Mar 27, 2014
    • Michael Armbrust's avatar
      Cut down the granularity of travis tests. · 5b2d863e
      Michael Armbrust authored
      This PR amortizes the cost of downloading all the jars and compiling core across more test cases.  In one anecdotal run this change takes the cumulative time down from ~80 minutes to ~40 minutes.
      
      Author: Michael Armbrust <michael@databricks.com>
      
      Closes #255 from marmbrus/travis and squashes the following commits:
      
      506b22d [Michael Armbrust] Cut down the granularity of travis tests so we can amortize the cost of compilation.
      5b2d863e
  5. Mar 25, 2014
    • Michael Armbrust's avatar
      Initial experimentation with Travis CI configuration · 4f7d547b
      Michael Armbrust authored
      This is not intended to replace Jenkins immediately, and Jenkins will remain the CI of reference for merging pull requests in the near term.  Long term, it is possible that Travis will give us better integration with github, so we are investigating its use.
      
      Author: Michael Armbrust <michael@databricks.com>
      
      Closes #230 from marmbrus/travis and squashes the following commits:
      
      93f9a32 [Michael Armbrust] Add Apache license to .travis.yml
      d7c0e78 [Michael Armbrust] Initial experimentation with Travis CI configuration
      4f7d547b
  6. Oct 08, 2013
  7. Oct 06, 2013
Loading