I have an application with the need to pass messages into multiple layers of processing. I need to do this because all the new messages should be put ...
I have an application with the need to pass messages into multiple layers of processing. I need to do this because all the new messages should be put ...
Im working on a project that uses kafka producer and consumer in order to acquire articles (with specific topics) from a news_api every two hours and ...
I'm using kafka-python==2.0.2, and have disabled auto_commit but still if I don't commit through code, offsets are automatically getting committed In ...
I made a simple configuration with Kafka. I ran it as a service on 2 Centos servers. While I can send and see logs to the logs topic with my python sc ...
I'm using kafka-python library for my fastapi consumer app and I'm consuming messages in batch with maximum of 100 records. Since the topic has huge t ...
I have a kafka-cluster of 3 nodes in 3 different AWS availablitiy zone. So 1 broker per zone. I produce 70 million messages in a burst once per day by ...
I am trying to read the earliest/oldest message which has not been read before in Kafka. I have set the parameters: As per the docs: The ena ...
In April 2021 Kafka released a version with early access to eliminating its dependency on Zookeeper. I've read many posts (mostly from 2021) saying th ...
I have a kafka topic partitioned into 60 partitions. Producer distributes messages in a default round-robin manner. So far so good. But when it comes ...
I have a system where I start two separate processes, one that produces messages to a kafka topic, and one process that runs a number of KafkaConsumer ...
I am trying to read the last message from a Kafka topic but I cannot make it work. I tried different methods that you can find below with their errors ...
I have two servers where bidirectional communication needs to be happened. For kafka I have 2 topics 2 producers and 2 consumers. Trying to communica ...
def getKafkaConsumer(topicName, kafkaIP, kafkaPort, kafkaConsumerGroup): try: bootstrap = [str(kafkaIP + ':' + kafkaPort)] consumer = KafkaConsumer(to ...
I have a Django 4 project and using KafkaConsumer from kafka-python. I want to update django models after receiving a Kafka message. The goal here is ...
I'm using Kafka to distribute load between my AI agents but my servers have different configurations and different rates for processing the input data ...
I am new to Python and trying to write a unit test which involves Kafka. I have a class with a function which calls another function to initialize Kaf ...
I have passed a Protobuf object in a Kafka producer and am receiving a byte array on the consumer side. Now I want to deserialize that response again ...
In the official documentation of kafka-python library there is literally nothing about what value is assigned to a consumed record .timestamp attribut ...
I have 2 certificate files, truststore.jks and keystore.jks. keystore.jks contains a full certificate chain for the kafka endpoint I'm using as well a ...
I am trying to read data from Oracle and send to a Kafka topic. I was able to read from oracle, put it into a dataframe and I put all parameters about ...