Staging instance, all changes can be removed at any time

Skip to content

celery: acknowledge tasks as soon as they're received

Nicolas Dandrimont requested to merge generated-differential-D5003-source into generated-differential-D5003-target

With late acknowledgements, RabbitMQ will re-send tasks to clients even if they can't ever complete the task (e.g. when the task gets killed because the machine is out of memory).

This problem only increases over time, leading to complete starvation of the ingestion system.

Now that we have multiple mechanisms to issue retries of tasks, we can use early acknowledgements for tasks instead, which should mitigate the ongoing starvation, at the expense of having to retry tasks externally.

(tangentially) Related to swh/infra/sysadm-environment#3025.

Migrated from D5003 (view on Phabricator)

Merge request reports