fuse: populate history/ incrementally to avoid temporary hangs on huge repos
Using a linux commit (swh:1:rev:f39d7d78b70e0f39facb1e4fab77ad3df5c52a35
), doing a swh-graph API call graph/visit/nodes/{SWHID}?edges=rev:rev
takes around 40s to complete/process all data, because we wait for all the history to be retrieved before starting to process it.
We should instead process it in a streaming fashion, starting to populate history/ incrementally, and using .status file to inform the user about progress.
Migrated from T2724 (view on Phabricator)
Edited by Phabricator Migration user