I have a relatively straightforward use case: Read Avro data from a Kafka topic Use KPL (v0.14.12) to send this data to Kinesis Data Streams U ...
I have a relatively straightforward use case: Read Avro data from a Kafka topic Use KPL (v0.14.12) to send this data to Kinesis Data Streams U ...
I have setup a kinesis data stream to capture RDS changes and adding data to this stream. Data is feeding to this stream as i can see from stream dash ...
I am using the Spring Cloud Stream Binder for Kinesis with KPL/KCL enabled. We would like to disable Cloudwatch metrics without having to manage the c ...
I am integrating kinesis in my java springboot project, i am able to publish the data into kinesis stream but while consuming it i am getting error li ...
I would like to use Spring Cloud Stream kinesis binder with KPL/KCL enabled. However, when I enabled that by using kpl-kcl-enabled: true the following ...
I have spring cloud stream application with kinesis binder The application can create resources on startup if not exists: kinesis streams, dynamodb t ...
I started to use both KPL and KCL to exchange data between services. But whenever consumer service is offline, all data sent by KPL are lost forever. ...
This is somewhat of a shallow-level question. However, I perplexed by this trio of services. I understand that KPL produces fast data and KCL consume ...
Streaming to Kinesis billions of messages a day. We're looking for an implementation that would allow us to deliver messages to Kinesis with exactly ...
I’m using Lambda to load data records into Kinesis and often want to add up to 500K records, I am batching these into chunks of 500 and using Boto's p ...
I am building Amazon Kinesis based streaming data ingestion from on-prem data source. I can use the Kinesis Producer Library (KPL) to produce messages ...
I am trying integrate spring cloud stream kinesis in my app but i cant find all configuration option in there manual. I have seen this link: https:// ...
Based on Kinesis documentation, sequence number is supposed to be unique, however we see the same value being reused across multiple records. Our even ...
The scenario is I would be writing large volumes of data ( terabytes per day) to kinesis stream.I want to know which is a better way to achieve high w ...
I am trying to use Kinesis, which expects data in byte buffer format. All the examples I have seen so far are in Java and pass simple strings. Can any ...
I have Spark job reads millions of records from Cassandra, filter out(business rules) and write to Kinesis stream. I don't find any example and testim ...
I'm trying to write to an Amazon Kinesis Firehose using the KPL library. Despite my best efforts, every attempt to connect and write to the library re ...
AWS Kinesis has a fairly low write throughput of 1000 writes/sec and 1MB/writes-sec. How does Kinesis enforce this limit? If I were to try to do 1500 ...
Since I am new to lambda and kinesis so apologies in advance. I have an SQS subscribed to SNS. A lambda polls the message from SQS and publish it to ...
Suppose i have a single shard Kinesis stream which allows 1MBps incoming. I have a producer using KPL which is trying to pump 2MBps (using async call ...