发送和接收日志到aws kinesis

Question

How can I send (receive) logs to (from) different kinesis stream shards using python boto3? I can send and receive when there is only one shard but can not figure out how will it work if I specify multiple shards for my kinesis stream.

Answer 1

You can use kinesis-agent library to push logs to kinesis streams, and use the KCL python library to read records from the stream. The KCL handles loads of stuff such as reading parallelly from multiple shards, resharding, etc.