简体   繁体   English

如何使用 KCL 使用来自 Kinesis Data Streams 的记录

[英]How to consume records from Kinesis Data Streams using KCL

I am trying to consume Kinesis data streams using Kinesis Client Library similar to https://github.com/aws-samples/amazon-kinesis-learning .我正在尝试使用类似于https://github.com/aws-samples/amazon-kinesis-learning的 Kinesis 客户端库来使用 Kinesis 数据流。 But in this example they scheduled the process.但在这个例子中,他们安排了这个过程。 I want to consume records afferent without scheduler.我想在没有调度程序的情况下使用传入的记录。

I don't want to use DynamoDB, cloudWatch.我不想使用 DynamoDB、cloudWatch。 Expecting a simple consumer to consume records in stream期望一个简单的消费者消费 stream 中的记录

Is there any way to process records without scheduler using java有没有办法使用 java 来处理没有调度程序的记录

KCL uses DynamoDB to manage shard leases and checkpoints - this functionality/dependency is critical to what KCL provides. KCL 使用 DynamoDB 管理分片租约和检查点——这种功能/依赖性对于 KCL 提供的功能至关重要。 If you do not want these, I'm not sure why you want to use KCL in the first place.如果您不想要这些,我不确定您为什么要首先使用 KCL。 You can either use Lambda to consume your stream, or invoke the APIs directly - there is some sample code here - https://docs.amazonaws.cn/en_us/streams/latest/dev/developing-consumers-with-sdk.html You can either use Lambda to consume your stream, or invoke the APIs directly - there is some sample code here - https://docs.amazonaws.cn/en_us/streams/latest/dev/developing-consumers-with-sdk.html

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 在 KCL 2.x ( Kinesis ) 下使用来自特定分片的记录 - Consume records from specific shards under KCL 2.x ( Kinesis ) 有没有办法使用运动学中的样本记录? - Is there a way to consume sample records from kinesis? 使用 Kinesis 客户端库 (KCL 2.x) 的多个使用者到 Kinesis Stream - Multiple consumers to the Kinesis Stream using Kinesis Client Library ( KCL 2.x ) 如何使用 KafkaStream 消费来自主题的记录......? - How to consume records from topic using KafkaStream..? 使用序列号和分区ID从Kinesis获取记录 - Get Records from Kinesis using sequence number and partition ID Apache Beam KinesisIO Java - 在 kinesis stream 中使用数据 - Apache Beam KinesisIO Java - Consume the data in a kinesis stream from where it left 在 aws kcl 中禁用 INFO 日志 - Kinesis - Disable INFO logs in aws kcl - Kinesis 对于AWS Kinesis的KCL Java库,如何使用requestShutdown和shutdown来执行正常关闭 - How do I use the requestShutdown and shutdown to do graceful shutdown in the case of KCL Java library for AWS Kinesis 将 Kinesis 客户端库 (KCL) 日志转储到文件 - Dump Kinesis Client Library (KCL) logs to file 如何将数据从服务器放到Kinesis Stream - How to put data from server to Kinesis Stream
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM