Celery with SQS broker & dead letter queue

Question

I'm trying to figure out how can I configure celery to move a message once it passed max_retries as configured, to the dead letter queue.

Currently it is deleting (acks) the message once exceeded max_retries .

Is there such an option?

Answer 1

At the moment, as far as I know, this is not possible but soon Celery should be able to do it . You can already test the branch from the PR mentioned in the Celery issue I linked to and see if it works as you expect.

Answer 2

following DejanLekic answer, I have created a dockerised project with local SQS demonstrating the solution he purposed

It can be seen here https://github.com/galCohen88/celery_sqs_redis_backend