Staging instance, all changes can be removed at any time

Skip to content
Snippets Groups Projects

cpan: Improve listing process by querying the metacpan release endpoint

Instead of querying the metacpan distribution endpoint to list origins, prefer to use the release endpoint instead enabling to list all artifacts associated to CPAN packages by scrolling results.

Compared to previous implementation, it enables to compute a last_update date for all CPAN packages but also to obtain artifact sha256 checksums that will be used by the CPAN loader to check downloads integrity.

It also enables to save a call to metacapan Web API in cpan loader as all needed info about package artifacts are now provided as extra loader arguments.

Related to #2833

When testing this in docker, I could list all CPAN packages and their artifacts in less than 4 minutes.


Migrated from D8615 (view on Phabricator)

Merge request reports

Closed by Phabricator Migration userPhabricator Migration user 2 years ago (Oct 11, 2022 3:15pm UTC)

Loading

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
Please register or sign in to reply
Loading