Staging instance, all changes can be removed at any time

Skip to content

Implement storage of listed origins

Nicolas Dandrimont requested to merge generated-differential-D3289-source into generated-differential-D3289-target

This new API endpoint allows listers to record the origins they have seen during their current run.

Origins are identified by the lister instance, the url of the origin, and the type of loader that should be used to load this origin.

The implementation allows listers just send the list of origins they've seen (with some lightweight extra information), leaving the backend to handle whether to do an insertion or an update to an existing origin.

The current implementation doesn't disable origins that have disappeared when doing a full listing run. This step will be done by a separate "origin garbage collection" endpoint, which will peruse the last_seen field.

Depends on !305 (closed). Related to #2442 (closed)

Test Plan

tox tests added for both the insert and update behaviors

Migrated from D3289 (view on Phabricator)

Merge request reports