Producer Connection Pool - Kafka

Question

I'm not able to understand how kafka maintain connection pool to the broker for the producer.

When i create a new object of producer and send a message to broker

producer = new Producer<Integer, String>(new ProducerConfig(props));
        producer.send(data);

will it return the connection from the connection pool ?

where is the Settings for the producer connection pool maintained in kafka ?

Answer 1

First of all, it depends on whether you are using a sync producer or async one. Let's assume you are using the sync producer.

There is no setting for maintaining producer pool as such. It will maintain as many threads as there are brokers. It will figure out the broker from the partition your key corresponds to and then use the dedicated thread for that broker. For more details please take a look at the field syncProducers in kafka source class ProducerPool.