Staging instance, all changes can be removed at any time

Skip to content

storage01.euwest.azure: Only keep the gunicorn-swh-storage service

The other services installed are unused. It still requires the objstorage-cloud profile though since that storage services uses the multiplexer objstorage (which includes the azure blobstorage access).

Related to T3901

Test Plan

This only keeps the gunicorn-swh-storage service and wants to drop the rest (from the diff) [1]:

$ $SWH_PUPPET_ENVIRONMENT_HOME/bin/octocatalog-diff storage01.euwest.azure
...
*******************************************
- Concat::Fragment[nginx-swh-indexer-storage-500-6666cd76f96956469e7be39d750cc7d9]
*******************************************
- Concat::Fragment[nginx-swh-indexer-storage-default-500-6666cd76f96956469e7be39d750cc7d9]
*******************************************
- Concat::Fragment[nginx-swh-indexer-storage-default-footer]
*******************************************
- Concat::Fragment[nginx-swh-indexer-storage-default-header]
*******************************************
- Concat::Fragment[nginx-swh-indexer-storage-footer]
*******************************************
- Concat::Fragment[nginx-swh-indexer-storage-header]
*******************************************
- Concat::Fragment[nginx-swh-objstorage-500-6666cd76f96956469e7be39d750cc7d9]
*******************************************
- Concat::Fragment[nginx-swh-objstorage-default-500-6666cd76f96956469e7be39d750cc7d9]
*******************************************
- Concat::Fragment[nginx-swh-objstorage-default-footer]
*******************************************
- Concat::Fragment[nginx-swh-objstorage-default-header]
*******************************************
- Concat::Fragment[nginx-swh-objstorage-footer]
*******************************************
- Concat::Fragment[nginx-swh-objstorage-header]
*******************************************
- Concat::Fragment[swh-indexer-storage-gunicorn_upstream_footer]
*******************************************
- Concat::Fragment[swh-indexer-storage-gunicorn_upstream_header]
*******************************************
- Concat::Fragment[swh-indexer-storage-gunicorn_upstream_member_gunicorn-indexer-storage]
*******************************************
- Concat::Fragment[swh-objstorage-gunicorn_upstream_footer]
*******************************************
- Concat::Fragment[swh-objstorage-gunicorn_upstream_header]
*******************************************
- Concat::Fragment[swh-objstorage-gunicorn_upstream_member_gunicorn-objstorage]
*******************************************
- Concat[/etc/nginx/conf.d/swh-indexer-storage-gunicorn-upstream.conf]
*******************************************
- Concat[/etc/nginx/conf.d/swh-objstorage-gunicorn-upstream.conf]
*******************************************
- Concat[/etc/nginx/sites-available/nginx-swh-indexer-storage-default.conf]
*******************************************
- Concat[/etc/nginx/sites-available/nginx-swh-indexer-storage.conf]
*******************************************
- Concat[/etc/nginx/sites-available/nginx-swh-objstorage-default.conf]
*******************************************
- Concat[/etc/nginx/sites-available/nginx-swh-objstorage.conf]
*******************************************
- Concat_file[/etc/nginx/conf.d/swh-indexer-storage-gunicorn-upstream.conf]
*******************************************
- Concat_file[/etc/nginx/conf.d/swh-objstorage-gunicorn-upstream.conf]
*******************************************
- Concat_file[/etc/nginx/sites-available/nginx-swh-indexer-storage-default.conf]
*******************************************
- Concat_file[/etc/nginx/sites-available/nginx-swh-indexer-storage.conf]
*******************************************
- Concat_file[/etc/nginx/sites-available/nginx-swh-objstorage-default.conf]
*******************************************
- Concat_file[/etc/nginx/sites-available/nginx-swh-objstorage.conf]
*******************************************
- Concat_file[profile::cron::borgmatic]
*******************************************
- Concat_fragment[nginx-swh-indexer-storage-500-6666cd76f96956469e7be39d750cc7d9]
*******************************************
- Concat_fragment[nginx-swh-indexer-storage-default-500-6666cd76f96956469e7be39d750cc7d9]
*******************************************
- Concat_fragment[nginx-swh-indexer-storage-default-footer]
*******************************************
- Concat_fragment[nginx-swh-indexer-storage-default-header]
*******************************************
- Concat_fragment[nginx-swh-indexer-storage-footer]
*******************************************
- Concat_fragment[nginx-swh-indexer-storage-header]
*******************************************
- Concat_fragment[nginx-swh-objstorage-500-6666cd76f96956469e7be39d750cc7d9]
*******************************************
- Concat_fragment[nginx-swh-objstorage-default-500-6666cd76f96956469e7be39d750cc7d9]
*******************************************
- Concat_fragment[nginx-swh-objstorage-default-footer]
*******************************************
- Concat_fragment[nginx-swh-objstorage-default-header]
*******************************************
- Concat_fragment[nginx-swh-objstorage-footer]
*******************************************
- Concat_fragment[nginx-swh-objstorage-header]
*******************************************
- Concat_fragment[profile::cron::borgmatic-create]
*******************************************
- Concat_fragment[profile::cron::borgmatic-full]
*******************************************
- Concat_fragment[profile::cron::borgmatic::_header]
*******************************************
- Concat_fragment[swh-indexer-storage-gunicorn_upstream_footer]
*******************************************
- Concat_fragment[swh-indexer-storage-gunicorn_upstream_header]
*******************************************
- Concat_fragment[swh-indexer-storage-gunicorn_upstream_member_gunicorn-indexer-storage]
*******************************************
- Concat_fragment[swh-objstorage-gunicorn_upstream_footer]
*******************************************
- Concat_fragment[swh-objstorage-gunicorn_upstream_header]
*******************************************
- Concat_fragment[swh-objstorage-gunicorn_upstream_member_gunicorn-objstorage]
*******************************************
- Exec[sed -e /dar\./d -e /swh-dar-backup/d -i /var/spool/cron/crontabs/root]
*******************************************
- Exec[ssh-keygen -t ed25519 -f /root/.ssh/id_ed25519.borg -N '']
*******************************************
- File[/etc/borgmatic/config.yaml]
*******************************************
- File[/etc/borgmatic]
*******************************************
- File[/etc/cron.d/puppet-borgmatic]
*******************************************
- File[/etc/gunicorn/instances/swh-indexer-storage.cfg]
*******************************************
- File[/etc/gunicorn/instances/swh-objstorage.cfg]
*******************************************
- File[/etc/logrotate.d/swh-dar]
*******************************************
- File[/etc/nginx/sites-enabled/nginx-swh-indexer-storage-default.conf]
*******************************************
- File[/etc/nginx/sites-enabled/nginx-swh-indexer-storage.conf]
*******************************************
- File[/etc/nginx/sites-enabled/nginx-swh-objstorage-default.conf]
*******************************************
- File[/etc/nginx/sites-enabled/nginx-swh-objstorage.conf]
*******************************************
- File[/etc/softwareheritage/objstorage/server.yml]
*******************************************
- File[/etc/softwareheritage/objstorage]
*******************************************
- File[/etc/softwareheritage/storage/indexer.yml]
*******************************************
- File[/etc/systemd/system/gunicorn-swh-indexer-storage.service]
*******************************************
- File[/etc/systemd/system/gunicorn-swh-objstorage.service]
*******************************************
- File[/etc/tmpfiles.d/gunicorn-swh-indexer-storage.conf]
*******************************************
- File[/etc/tmpfiles.d/gunicorn-swh-objstorage.conf]
*******************************************
- File[/srv/backups]
*******************************************
- File[/usr/local/bin/swh-dar-backup]
*******************************************
- File[/var/lib/borg]
*******************************************
- File[/var/log/dar]
*******************************************
- Gunicorn::Instance[swh-indexer-storage]
*******************************************
- Gunicorn::Instance[swh-objstorage]
*******************************************
- Nginx::Resource::Location[nginx-swh-indexer-storage-default-default]
*******************************************
- Nginx::Resource::Location[nginx-swh-indexer-storage-default]
*******************************************
- Nginx::Resource::Location[nginx-swh-objstorage-default-default]
*******************************************
- Nginx::Resource::Location[nginx-swh-objstorage-default]
*******************************************
- Nginx::Resource::Server[nginx-swh-indexer-storage-default]
*******************************************
- Nginx::Resource::Server[nginx-swh-indexer-storage]
*******************************************
- Nginx::Resource::Server[nginx-swh-objstorage-default]
*******************************************
- Nginx::Resource::Server[nginx-swh-objstorage]
*******************************************
- Nginx::Resource::Upstream::Member[gunicorn-indexer-storage]
*******************************************
- Nginx::Resource::Upstream::Member[gunicorn-objstorage]
*******************************************
- Nginx::Resource::Upstream[swh-indexer-storage-gunicorn]
*******************************************
- Nginx::Resource::Upstream[swh-objstorage-gunicorn]
*******************************************
- Package[borgbackup]
*******************************************
- Package[borgmatic]
*******************************************
- Package[python3-swh.indexer.storage]
*******************************************
- Package[python3-swh.objstorage]
*******************************************
- Profile::Cron::D[borgmatic-create]
*******************************************
- Profile::Cron::D[borgmatic-full]
*******************************************
- Profile::Cron::File[borgmatic]
*******************************************
- Profile::Swh::Deploy::Rpc_server[indexer-storage]
*******************************************
- Profile::Swh::Deploy::Rpc_server[objstorage]
*******************************************
- Service[gunicorn-swh-indexer-storage]
*******************************************
- Service[gunicorn-swh-objstorage]
*******************************************
- Systemd::Tmpfile[gunicorn-swh-indexer-storage.conf]
*******************************************
- Systemd::Tmpfile[gunicorn-swh-objstorage.conf]
*******************************************
- Systemd::Unit_file[gunicorn-swh-indexer-storage.service]
*******************************************
- Systemd::Unit_file[gunicorn-swh-objstorage.service]
*******************************************
*** End octocatalog-diff on storage01.euwest.azure.internal.softwareheritage.org

The actual service clean up will happen manually on that node.


Migrated from D7055 (view on Phabricator)

Merge request reports

Loading