Kinesis to s3 bucket using Kinesis Connector

Question

I am getting the following error while accessing the s3 bucket from kinesis using the kinesis connector library . I have used the samples from the following link

https://github.com/awslabs/amazon-kinesis-connectors/tree/master/src/main/samples

INFO: Stream twitterStreamNew is ACTIVE
Oct 16, 2015 3:45:00 PM com.yash.KinesisConnectorExecutor setupInputStream
INFO: Starting stream source.
Exception in thread "main" java.lang.NoClassDefFoundError: com/amazonaws/transform/JsonErrorUnmarshallerV2
    at com.amazonaws.services.dynamodbv2.AmazonDynamoDBClient.init(AmazonDynamoDBClient.java:387)
    at com.amazonaws.services.dynamodbv2.AmazonDynamoDBClient.(AmazonDynamoDBClient.java:383)
    at com.amazonaws.services.dynamodbv2.AmazonDynamoDBClient.(AmazonDynamoDBClient.java:357)
    at com.amazonaws.services.kinesis.clientlibrary.lib.worker.Worker.(Worker.java:109)
    at com.amazonaws.services.kinesis.clientlibrary.lib.worker.Worker.(Worker.java:94)
    at com.amazonaws.services.kinesis.connectors.KinesisConnectorExecutorBase.initialize(KinesisConnectorExecutorBase.java:84)
    at com.amazonaws.services.kinesis.connectors.KinesisConnectorExecutorBase.initialize(KinesisConnectorExecutorBase.java:37)
    at com.example.KinesisConnectorExecutor.



    (KinesisConnectorExecutor.java:110)
    at com.example.S3Executor.(S3Executor.java:19)
    at com.example.S3Executor.main(S3Executor.java:34)
    Caused by: java.lang.ClassNotFoundException:       com.amazonaws.transform.JsonErrorUnmarshallerV2
    at java.net.URLClassLoader.findClass(Unknown Source)
    at java.lang.ClassLoader.loadClass(Unknown Source)
    at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source)
    at java.lang.ClassLoader.loadClass(Unknown Source)
    ... 10 more

Answer 1

Had the same error - was simply due to conflicting library versions.

Update your kinesis connector library and aws java sdk to the latest versions in your POM.

    <dependency>
        <groupId>com.amazonaws</groupId>
        <artifactId>aws-java-sdk</artifactId>
        <version>1.10.27</version>
    </dependency>

    <dependency>
        <groupId>com.amazonaws</groupId>
        <artifactId>amazon-kinesis-connectors</artifactId>
        <version>1.2.0</version>
    </dependency>