Skip to content
  • Thomas Graves's avatar
    0c3e4150
    SPARK-1474: Spark on yarn assembly doesn't include AmIpFilter · 0c3e4150
    Thomas Graves authored
    
    
    We use org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter in spark on yarn but are not included it in the assembly jar.
    
    I tested this on yarn cluster by removing the yarn jars from the classpath and spark runs fine now.
    
    Author: Thomas Graves <tgraves@apache.org>
    
    Closes #406 from tgravescs/SPARK-1474 and squashes the following commits:
    
    1548bf9 [Thomas Graves] SPARK-1474: Spark on yarn assembly doesn't include org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter
    (cherry picked from commit 1e829905)
    
    Signed-off-by: default avatarPatrick Wendell <pwendell@gmail.com>
    0c3e4150
    SPARK-1474: Spark on yarn assembly doesn't include AmIpFilter
    Thomas Graves authored
    
    
    We use org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter in spark on yarn but are not included it in the assembly jar.
    
    I tested this on yarn cluster by removing the yarn jars from the classpath and spark runs fine now.
    
    Author: Thomas Graves <tgraves@apache.org>
    
    Closes #406 from tgravescs/SPARK-1474 and squashes the following commits:
    
    1548bf9 [Thomas Graves] SPARK-1474: Spark on yarn assembly doesn't include org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter
    (cherry picked from commit 1e829905)
    
    Signed-off-by: default avatarPatrick Wendell <pwendell@gmail.com>
Loading