Implement automated tools for takedown notices

• Create a new module: swh/devel/swh-alter>
• Register the new module:
  • mrconfig: swh/devel/swh-environment!256 (merged)
  • Jenkins: swh/infra/ci-cd/swh-jenkins-jobs!162 (merged)
  • v0.0.0 release
  • swh-docs
• Migrate graph removal code from snippets to swh-alter
  • Implement the algorithm to determine which objects should and can be removed for a set of origins (swh/devel/swh-alter#1 (closed))
    • Implement the inbound edge lookup and storage interfaces in PostgreSQL (swh/devel/swh-storage#4681 (closed))
    • Implement the inbound edge lookup and storage interfaces in Cassandra (swh/devel/swh-storage#4682)
    • Implement a reference recording proxy for swh.storage (swh/devel/swh-storage#4683 (closed))
    • Deploy the reference recording proxy
    • Deploy a new export of swh-graph (swh/infra/sysadm-environment#5072 (closed))
  • Support removing data from PostgreSQL storage (swh/devel/swh-alter#2 (closed))
    • Allow removing objects from PostgreSQL storage (swh/devel/swh-storage#4687 (closed))
• Produce removal backups (swh/devel/swh-alter#6 (closed))
• Support undoing removal from backups (swh/devel/swh-alter#7 (closed))
• Prevent race conditions by looking if any new references have been added to a removed object. If that happened, use the backup and restore it.
• Add some integration tests in swh-environment/docker/tests (swh/devel/swh-environment!292 (merged))
• Ensure that creating recovery bundle, removing objects, and restoring bundles is reliable on staging (swh/infra/sysadm-environment#5046 (closed))
  • Create test repositories (#5084 (closed))
• Support removing data from Cassandra (swh/devel/swh-alter#5 (closed))
  • Implement ObjectDeletionInterface in Cassandra storage (swh/devel/swh-storage!1086 (merged))
• Support removing data from objstorage
  • Implement delete() in Winery (swh/devel/swh-objstorage!166 (merged))
  • Wire objstorage.delete in swh alter remove (swh/devel/swh-alter!15 (merged))
  • Implement integration tests for removal/restore from objstorage (swh/devel/docker!4 (merged))
• Support removing data from swh-journal (swh/devel/swh-alter#3 (closed))
  • Allow object removal from journal (swh/devel/swh-journal#4657 (closed))
  • Add integration tests for removal/restore with the journal (swh/devel/swh-environment!294 (merged))
  • Think and test what would be the best Kafka topic settings for topic compaction.
• Support removing data from ElasticSearch
  • Implement SearchInterface.delete() in swh-search (swh/devel/swh-search#4652 (closed))
  • Wire deletion in swh-alter (swh/devel/swh-alter!18 (merged))
  • Implement integration tests for removal/restore from Elasticsearch (swh/devel/docker!7 (merged))
• Allow removal of RawExtrinsicMetadata and ExtID objects (swh/devel/swh-alter#11 (closed))