Skip to content
Snippets Groups Projects
  • Dongjoon Hyun's avatar
    473263f9
    [SPARK-13834][BUILD] Update sbt and sbt plugins for 2.x. · 473263f9
    Dongjoon Hyun authored
    ## What changes were proposed in this pull request?
    
    For 2.0.0, we had better make **sbt** and **sbt plugins** up-to-date. This PR checks the status of each plugins and bumps the followings.
    
    * sbt: 0.13.9 --> 0.13.11
    * sbteclipse-plugin: 2.2.0 --> 4.0.0
    * sbt-dependency-graph: 0.7.4 --> 0.8.2
    * sbt-mima-plugin: 0.1.6 --> 0.1.9
    * sbt-revolver: 0.7.2 --> 0.8.0
    
    All other plugins are up-to-date. (Note that `sbt-avro` seems to be change from 0.3.2 to 1.0.1, but it's not published in the repository.)
    
    During upgrade, this PR also updated the following MiMa error. Note that the related excluding filter is already registered correctly. It seems due to the change of MiMa exception result.
    ```
     // SPARK-12896 Send only accumulator updates to driver, not TaskMetrics
     ProblemFilters.exclude[IncompatibleMethTypeProblem]("org.apache.spark.Accumulable.this"),
    -ProblemFilters.exclude[IncompatibleMethTypeProblem]("org.apache.spark.Accumulator.this"),
    +ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.Accumulator.this"),
    ```
    
    ## How was this patch tested?
    
    Pass the Jenkins build.
    
    Author: Dongjoon Hyun <dongjoon@apache.org>
    
    Closes #11669 from dongjoon-hyun/update_mima.
    473263f9
    History
    [SPARK-13834][BUILD] Update sbt and sbt plugins for 2.x.
    Dongjoon Hyun authored
    ## What changes were proposed in this pull request?
    
    For 2.0.0, we had better make **sbt** and **sbt plugins** up-to-date. This PR checks the status of each plugins and bumps the followings.
    
    * sbt: 0.13.9 --> 0.13.11
    * sbteclipse-plugin: 2.2.0 --> 4.0.0
    * sbt-dependency-graph: 0.7.4 --> 0.8.2
    * sbt-mima-plugin: 0.1.6 --> 0.1.9
    * sbt-revolver: 0.7.2 --> 0.8.0
    
    All other plugins are up-to-date. (Note that `sbt-avro` seems to be change from 0.3.2 to 1.0.1, but it's not published in the repository.)
    
    During upgrade, this PR also updated the following MiMa error. Note that the related excluding filter is already registered correctly. It seems due to the change of MiMa exception result.
    ```
     // SPARK-12896 Send only accumulator updates to driver, not TaskMetrics
     ProblemFilters.exclude[IncompatibleMethTypeProblem]("org.apache.spark.Accumulable.this"),
    -ProblemFilters.exclude[IncompatibleMethTypeProblem]("org.apache.spark.Accumulator.this"),
    +ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.Accumulator.this"),
    ```
    
    ## How was this patch tested?
    
    Pass the Jenkins build.
    
    Author: Dongjoon Hyun <dongjoon@apache.org>
    
    Closes #11669 from dongjoon-hyun/update_mima.
examples NaN GiB