Skip to content
Snippets Groups Projects
Commit 87f82a5f authored by Xiangrui Meng's avatar Xiangrui Meng Committed by Tathagata Das
Browse files

[SPARK-11127][STREAMING] upgrade AWS SDK and Kinesis Client Library (KCL)

AWS SDK 1.9.40 is the latest 1.9.x release. KCL 1.5.1 is the latest release that using AWS SDK 1.9.x. The main goal is to have Kinesis consumer be able to read messages generated from Kinesis Producer Library (KPL). The API should be compatible with old versions.

tdas brkyvz

Author: Xiangrui Meng <meng@databricks.com>

Closes #9153 from mengxr/SPARK-11127.
parent 85e654c5
No related branches found
No related tags found
No related merge requests found
......@@ -152,8 +152,8 @@
<avro.version>1.7.7</avro.version>
<avro.mapred.classifier>hadoop2</avro.mapred.classifier>
<jets3t.version>0.7.1</jets3t.version>
<aws.java.sdk.version>1.9.16</aws.java.sdk.version>
<aws.kinesis.client.version>1.3.0</aws.kinesis.client.version>
<aws.java.sdk.version>1.9.40</aws.java.sdk.version>
<aws.kinesis.client.version>1.4.0</aws.kinesis.client.version>
<!-- org.apache.httpcomponents/httpclient-->
<commons.httpclient.version>4.3.2</commons.httpclient.version>
<!-- commons-httpclient/commons-httpclient-->
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment