Skip to content
Snippets Groups Projects
  • Reynold Xin's avatar
    37e52f87
    [SPARK-18639] Build only a single pip package · 37e52f87
    Reynold Xin authored
    ## What changes were proposed in this pull request?
    We current build 5 separate pip binary tar balls, doubling the release script runtime. It'd be better to build one, especially for use cases that are just using Spark locally. In the long run, it would make more sense to have Hadoop support be pluggable.
    
    ## How was this patch tested?
    N/A - this is a release build script that doesn't have any automated test coverage. We will know if it goes wrong when we prepare releases.
    
    Author: Reynold Xin <rxin@databricks.com>
    
    Closes #16072 from rxin/SPARK-18639.
    37e52f87
    History
    [SPARK-18639] Build only a single pip package
    Reynold Xin authored
    ## What changes were proposed in this pull request?
    We current build 5 separate pip binary tar balls, doubling the release script runtime. It'd be better to build one, especially for use cases that are just using Spark locally. In the long run, it would make more sense to have Hadoop support be pluggable.
    
    ## How was this patch tested?
    N/A - this is a release build script that doesn't have any automated test coverage. We will know if it goes wrong when we prepare releases.
    
    Author: Reynold Xin <rxin@databricks.com>
    
    Closes #16072 from rxin/SPARK-18639.
release-build.sh 13.61 KiB