RabbitMQ: Move messages to another queue on acknowledgement received

Question

I have a setup with two queues (no exchanges), let's say queue A and queue B.

One parser puts messages on queue A, that are consumed by ElasticSearch RabbitMQ river.

What I want now is to move messages from queue A to queue B when the ES river sends an ack to the queue A, so that I can do other processing in the ack'd messages, being sure that ES already has processed them.

Is there any way in RabbitMQ to do this? If not, is there any other setup that can guarantee me that a message is only in queue B after being processed by ES?

Thanks in advance

Answer 1

I don't think this is supported by either AMQP or the rabbitmq extensions .

1. You could drop the river and let your consumer also publish to elasticsearch.

2. Since a normal behavior is that the queues are empty you can just perform a few retries of reading the entries from elasticsearch (with exponential backoff), so even if the elasticsearch loses the initial race it will backoff a bit and you can then perform the task. This might require tuning the prefetch_size/count in your clients.