-
- Downloads
[SPARK-9263] Added flags to exclude dependencies when using --packages
While the functionality is there to exclude packages, there are no flags that allow users to exclude dependencies, in case of dependency conflicts. We should provide users with a flag to add dependency exclusions in case the packages are not resolved properly (or not available due to licensing). The flag I added was --packages-exclude, but I'm open on renaming it. I also added property flags in case people would like to use a conf file to provide dependencies, which is possible if there is a long list of dependencies or exclusions. cc andrewor14 vanzin pwendell Author: Burak Yavuz <brkyvz@gmail.com> Closes #7599 from brkyvz/packages-exclusions and squashes the following commits: 636f410 [Burak Yavuz] addressed nits 6e54ede [Burak Yavuz] is this the culprit b5e508e [Burak Yavuz] Merge branch 'master' of github.com:apache/spark into packages-exclusions 154f5db [Burak Yavuz] addressed initial comments 1536d7a [Burak Yavuz] Added flags to exclude packages using --packages-exclude
Showing
- core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala 14 additions, 15 deletions.../src/main/scala/org/apache/spark/deploy/SparkSubmit.scala
- core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala 11 additions, 0 deletions.../scala/org/apache/spark/deploy/SparkSubmitArguments.scala
- core/src/test/scala/org/apache/spark/deploy/SparkSubmitUtilsSuite.scala 30 additions, 0 deletions...scala/org/apache/spark/deploy/SparkSubmitUtilsSuite.scala
- launcher/src/main/java/org/apache/spark/launcher/SparkSubmitOptionParser.java 2 additions, 0 deletions...va/org/apache/spark/launcher/SparkSubmitOptionParser.java
Loading
Please register or sign in to comment