Skip to content
Snippets Groups Projects
  • Dongjoon Hyun's avatar
    c618ccdb
    [SPARK-19464][BUILD][HOTFIX] run-tests should use hadoop2.6 · c618ccdb
    Dongjoon Hyun authored
    ## What changes were proposed in this pull request?
    
    After SPARK-19464, **SparkPullRequestBuilder** fails because it still tries to use hadoop2.3.
    
    **BEFORE**
    https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72595/console
    ```
    ========================================================================
    Building Spark
    ========================================================================
    [error] Could not find hadoop2.3 in the list. Valid options  are ['hadoop2.6', 'hadoop2.7']
    Attempting to post to Github...
     > Post successful.
    ```
    
    **AFTER**
    https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72595/console
    ```
    ========================================================================
    Building Spark
    ========================================================================
    [info] Building Spark (w/Hive 1.2.1) using SBT with these arguments:  -Phadoop-2.6 -Pmesos -Pkinesis-asl -Pyarn -Phive-thriftserver -Phive test:package streaming-kafka-0-8-assembly/assembly streaming-flume-assembly/assembly streaming-kinesis-asl-assembly/assembly
    Using /usr/java/jdk1.8.0_60 as default JAVA_HOME.
    Note, this will be overridden by -java-home if it is set.
    ```
    
    ## How was this patch tested?
    
    Pass the existing test.
    
    Author: Dongjoon Hyun <dongjoon@apache.org>
    
    Closes #16858 from dongjoon-hyun/hotfix_run-tests.
    [SPARK-19464][BUILD][HOTFIX] run-tests should use hadoop2.6
    Dongjoon Hyun authored
    ## What changes were proposed in this pull request?
    
    After SPARK-19464, **SparkPullRequestBuilder** fails because it still tries to use hadoop2.3.
    
    **BEFORE**
    https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72595/console
    ```
    ========================================================================
    Building Spark
    ========================================================================
    [error] Could not find hadoop2.3 in the list. Valid options  are ['hadoop2.6', 'hadoop2.7']
    Attempting to post to Github...
     > Post successful.
    ```
    
    **AFTER**
    https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72595/console
    ```
    ========================================================================
    Building Spark
    ========================================================================
    [info] Building Spark (w/Hive 1.2.1) using SBT with these arguments:  -Phadoop-2.6 -Pmesos -Pkinesis-asl -Pyarn -Phive-thriftserver -Phive test:package streaming-kafka-0-8-assembly/assembly streaming-flume-assembly/assembly streaming-kinesis-asl-assembly/assembly
    Using /usr/java/jdk1.8.0_60 as default JAVA_HOME.
    Note, this will be overridden by -java-home if it is set.
    ```
    
    ## How was this patch tested?
    
    Pass the existing test.
    
    Author: Dongjoon Hyun <dongjoon@apache.org>
    
    Closes #16858 from dongjoon-hyun/hotfix_run-tests.