Skip to content
  • Sean Owen's avatar
    aff49a3e
    SPARK-5172 [BUILD] spark-examples-***.jar shades a wrong Hadoop distribution · aff49a3e
    Sean Owen authored
    In addition to the `hadoop-2.x` profiles in the parent POM, there is actually another set of profiles in `examples` that has to be activated differently to get the right Hadoop 1 vs 2 flavor of HBase. This wasn't actually used in making Hadoop 2 distributions, hence the problem.
    
    To reduce complexity, I suggest merging them with the parent POM profiles, which is possible now.
    
    You'll see this changes appears to update the HBase version, but actually, the default 0.94 version was not being used. HBase is only used in examples, and the examples POM always chose one profile or the other that updated the version to 0.98.x anyway.
    
    Author: Sean Owen <sowen@cloudera.com>
    
    Closes #3992 from srowen/SPARK-5172 and squashes the following commits:
    
    17830d9 [Sean Owen] Control hbase hadoop1/2 flavor in the parent POM with existing hadoop-2.x profiles
    aff49a3e
    SPARK-5172 [BUILD] spark-examples-***.jar shades a wrong Hadoop distribution
    Sean Owen authored
    In addition to the `hadoop-2.x` profiles in the parent POM, there is actually another set of profiles in `examples` that has to be activated differently to get the right Hadoop 1 vs 2 flavor of HBase. This wasn't actually used in making Hadoop 2 distributions, hence the problem.
    
    To reduce complexity, I suggest merging them with the parent POM profiles, which is possible now.
    
    You'll see this changes appears to update the HBase version, but actually, the default 0.94 version was not being used. HBase is only used in examples, and the examples POM always chose one profile or the other that updated the version to 0.98.x anyway.
    
    Author: Sean Owen <sowen@cloudera.com>
    
    Closes #3992 from srowen/SPARK-5172 and squashes the following commits:
    
    17830d9 [Sean Owen] Control hbase hadoop1/2 flavor in the parent POM with existing hadoop-2.x profiles
Loading