Skip to content
Snippets Groups Projects
  • BrianLondon's avatar
    8fe928b4
    [SPARK-12269][STREAMING][KINESIS] Update aws-java-sdk version · 8fe928b4
    BrianLondon authored
    The current Spark Streaming kinesis connector references a quite old version 1.9.40 of the AWS Java SDK (1.10.40 is current). Numerous AWS features including Kinesis Firehose are unavailable in 1.9. Those two versions of the AWS SDK in turn require conflicting versions of Jackson (2.4.4 and 2.5.3 respectively) such that one cannot include the current AWS SDK in a project that also uses the Spark Streaming Kinesis ASL.
    
    Author: BrianLondon <brian@seatgeek.com>
    
    Closes #10256 from BrianLondon/master.
    8fe928b4
    History
    [SPARK-12269][STREAMING][KINESIS] Update aws-java-sdk version
    BrianLondon authored
    The current Spark Streaming kinesis connector references a quite old version 1.9.40 of the AWS Java SDK (1.10.40 is current). Numerous AWS features including Kinesis Firehose are unavailable in 1.9. Those two versions of the AWS SDK in turn require conflicting versions of Jackson (2.4.4 and 2.5.3 respectively) such that one cannot include the current AWS SDK in a project that also uses the Spark Streaming Kinesis ASL.
    
    Author: BrianLondon <brian@seatgeek.com>
    
    Closes #10256 from BrianLondon/master.
pom.xml 86.78 KiB