I am currently trying to understand how Kafka Streams achieves parallelism. My main concern boils down to three questions: Can multiple sub-topolo ...
I am currently trying to understand how Kafka Streams achieves parallelism. My main concern boils down to three questions: Can multiple sub-topolo ...
I receive containers of senor data as an input for ASA. Containers look like this. The data is send from different vehicles. The vehicle identifier ...
I am considering using Flink or Apache Beam (with the flink runner) for different stream processing applications. I am trying to compare the two optio ...
I'm calculating a simple mean on a dataset with values for May 2022, using different windows sizes. Using 1 hour windows there are no problems, while ...
I'm calculating a simple mean on some records, using different windows sizes. Using 1 hour and 1 week windows there are no problems, and the results a ...
I am writing a consumer that consumes (user activity data, (activityid, userid, timestamp, cta, duration) from Google Pub/Sub and I want to create a s ...
I'd like to join data coming in from two Kafka topics ("left" and "right"). Matching records are to be joined using an ID, but if a "left" or a "righ ...
Redpanda seems easy to work with, but how would one process streams in real-time? We have a few thousand IoT devices that send us data every second. ...
We have a few thousand IoT devices that send us their temperature every second. The input source can be MQTT or JSON (or a queue if needed). Our goal ...
Context - Application We have an Apache Flink application which processes events The application uses event time characteristics The applicatio ...
I am trying to read data from a kafka topic do some processing and dump the data into elasticsearch. But I could not find example in python ti use Ela ...
Im new to pyflink. Im tryig to write a python program to read data from kafka topic and prints data to stdout. I followed the link Flink Python Datast ...
I cannot find this in the Hazelcast Jet 5.0 (or 4.x) documentation, so I hope someone can answer this here - can a reliable topic be used as an idempo ...
I'm working on a project that will determine whether or not I score an internship. The project focuses on stream processing and is due in 2 weeks. It' ...
I have a relatively basic use case. My data lives in a few 100 kafka partitions and I need to pass the events through a map operator before I send the ...
I would expect windows to trigger only after we wait until the maximum possible time as defined by the max lateness for watermark. .assignTimestam ...
. Answers to this question are eligible for a +50 reputation bounty. Ch ...
I am trying to catch pattern with Apache Flink CEP (Complex Event Processing) Library. I started with the following structure, and I expect to see 2 m ...
I am creating a stream processor using PyFlink. When I connect Kafka to Flink, everything works fine. But when I send json data to kafka, PyFlink rece ...
Say, I have a very complex Apache Storm topology that is created randomly for some experiments and results in an StormTopology object. I am now inter ...