我如何使用kafka-python成为批处理使用者？

Question

I've been looking for a while but I can't find a way to create a batch consumer with kafka-python . I found a guide for Java but it isn't exactly what I am trying to achieve. Indeed, my goal is just to consume a fixed number of records let's say and process them (perform some transformations) and after that, store them into a Database.

Answer 1

this is one consumer argument:

max_poll_records (int) – The maximum number of records returned in a single call to poll(). Default: 500

i think kafka-python can do batch consume with a max number of records, maybe not exactly what your saying a fixed number.