swh/staging: Add objstorage checker
Related to product-management/core-platform#23
These modifications will deploy an objstorage scrubber with the name objstorage-contents for the object type content.
I also changed the container name in the storage-checker-deployment file, this explain the lots of differences in 'Helm diff' (the new deployment is the one in staging namespace swh-cassandra section).
Helm diff
[swh] Comparing changes between branches production and staging_objstorage_checker (per environment)...
Your branch is up to date with 'origin/production'.
[swh] Generate config in production branch for environment staging, namespace swh...
[swh] Generate config in production branch for environment staging, namespace swh-cassandra...
[swh] Generate config in production branch for environment staging, namespace swh-cassandra-next-version...
Your branch is up to date with 'origin/staging_objstorage_checker'.
[swh] Generate config in staging_objstorage_checker branch for environment staging...
[swh] Generate config in staging_objstorage_checker branch for environment staging...
[swh] Generate config in staging_objstorage_checker branch for environment staging...
Your branch is up to date with 'origin/production'.
[swh] Generate config in production branch for environment production, namespace swh...
[swh] Generate config in production branch for environment production, namespace swh-cassandra...
[swh] Generate config in production branch for environment production, namespace swh-cassandra-next-version...
Your branch is up to date with 'origin/staging_objstorage_checker'.
[swh] Generate config in staging_objstorage_checker branch for environment production...
[swh] Generate config in staging_objstorage_checker branch for environment production...
[swh] Generate config in staging_objstorage_checker branch for environment production...
------------- diff for environment staging namespace swh -------------
_ __ __
_| |_ _ / _|/ _| between /tmp/swh-chart.swh.cC9GqilE/staging-swh.before, 113 documents
/ _' | | | | |_| |_ and /tmp/swh-chart.swh.cC9GqilE/staging-swh.after, 113 documents
| (_| | |_| | _| _|
\__,_|\__, |_| |_| returned two differences
|___/
spec.template.spec.containers (apps/v1/Deployment/swh/scrubber-storagechecker-directory-hashes)
- one list entry removed:
- name: strorage-checker
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
imagePullPolicy: IfNotPresent
command:
- /opt/swh/entrypoint.sh
args:
- swh
- scrubber
- check
- run
- storage-hashes-directory
resources:
requests:
memory: 100Mi
cpu: 100m
volumeMounts:
- name: configuration
mountPath: /etc/swh
env:
- name: STATSD_HOST
value: prometheus-statsd-exporter
- name: STATSD_PORT
value: 9125
- name: STATSD_TAGS
value: "deployment:scrubber-storagechecker-directory-hashes"
- name: MAX_TASKS_PER_CHILD
value: 1
- name: SWH_LOG_LEVEL
value: INFO
- name: SWH_CONFIG_FILENAME
value: /etc/swh/config.yml
- name: SWH_SENTRY_ENVIRONMENT
value: staging
- name: SWH_MAIN_PACKAGE
value: swh.scrubber
- name: SWH_SENTRY_DSN
valueFrom:
secretKeyRef:
name: common-secrets
key: scrubber-sentry-dsn
# 'name' secret must exist & include key "host"
optional: false
+ one list entry added:
- name: storage-checker
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
imagePullPolicy: IfNotPresent
command:
- /opt/swh/entrypoint.sh
args:
- swh
- scrubber
- check
- run
- storage-hashes-directory
resources:
requests:
memory: 100Mi
cpu: 100m
volumeMounts:
- name: configuration
mountPath: /etc/swh
env:
- name: STATSD_HOST
value: prometheus-statsd-exporter
- name: STATSD_PORT
value: 9125
- name: STATSD_TAGS
value: "deployment:scrubber-storagechecker-directory-hashes"
- name: MAX_TASKS_PER_CHILD
value: 1
- name: SWH_LOG_LEVEL
value: INFO
- name: SWH_CONFIG_FILENAME
value: /etc/swh/config.yml
- name: SWH_SENTRY_ENVIRONMENT
value: staging
- name: SWH_MAIN_PACKAGE
value: swh.scrubber
- name: SWH_SENTRY_DSN
valueFrom:
secretKeyRef:
name: common-secrets
key: scrubber-sentry-dsn
# 'name' secret must exist & include key "host"
optional: false
spec.template.spec.containers (apps/v1/Deployment/swh/scrubber-storagechecker-directory-references)
- one list entry removed:
- name: strorage-checker
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
imagePullPolicy: IfNotPresent
command:
- /opt/swh/entrypoint.sh
args:
- swh
- scrubber
- check
- run
- storage-references-directory
resources:
requests:
memory: 100Mi
cpu: 100m
volumeMounts:
- name: configuration
mountPath: /etc/swh
env:
- name: STATSD_HOST
value: prometheus-statsd-exporter
- name: STATSD_PORT
value: 9125
- name: STATSD_TAGS
value: "deployment:scrubber-storagechecker-directory-references"
- name: MAX_TASKS_PER_CHILD
value: 1
- name: SWH_LOG_LEVEL
value: INFO
- name: SWH_CONFIG_FILENAME
value: /etc/swh/config.yml
- name: SWH_SENTRY_ENVIRONMENT
value: staging
- name: SWH_MAIN_PACKAGE
value: swh.scrubber
- name: SWH_SENTRY_DSN
valueFrom:
secretKeyRef:
name: common-secrets
key: scrubber-sentry-dsn
# 'name' secret must exist & include key "host"
optional: false
+ one list entry added:
- name: storage-checker
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
imagePullPolicy: IfNotPresent
command:
- /opt/swh/entrypoint.sh
args:
- swh
- scrubber
- check
- run
- storage-references-directory
resources:
requests:
memory: 100Mi
cpu: 100m
volumeMounts:
- name: configuration
mountPath: /etc/swh
env:
- name: STATSD_HOST
value: prometheus-statsd-exporter
- name: STATSD_PORT
value: 9125
- name: STATSD_TAGS
value: "deployment:scrubber-storagechecker-directory-references"
- name: MAX_TASKS_PER_CHILD
value: 1
- name: SWH_LOG_LEVEL
value: INFO
- name: SWH_CONFIG_FILENAME
value: /etc/swh/config.yml
- name: SWH_SENTRY_ENVIRONMENT
value: staging
- name: SWH_MAIN_PACKAGE
value: swh.scrubber
- name: SWH_SENTRY_DSN
valueFrom:
secretKeyRef:
name: common-secrets
key: scrubber-sentry-dsn
# 'name' secret must exist & include key "host"
optional: false
------------- diff for environment staging namespace swh-cassandra -------------
_ __ __
_| |_ _ / _|/ _| between /tmp/swh-chart.swh.cC9GqilE/staging-swh-cassandra.before, 386 documents
/ _' | | | | |_| |_ and /tmp/swh-chart.swh.cC9GqilE/staging-swh-cassandra.after, 388 documents
| (_| | |_| | _| _|
\__,_|\__, |_| |_| returned one difference
|___/
(file level)
---
# Source: swh/templates/scrubber/objstorage-checker-configmap.yaml
apiVersion: v1
kind: ConfigMap
metadata:
name: scrubber-objstoragechecker-contents-template
namespace: swh-cassandra
data:
config.yml.template: |
scrubber:
cls: postgresql
db: host=db1.internal.staging.swh.network port=5432 user=swh-scrubber dbname=swh-scrubber
password=${SCRUBBER_POSTGRESQL_PASSWORD}
storage:
auth_provider:
cls: cassandra.auth.PlainTextAuthProvider
password: ${CASSANDRA_PASSWORD}
username: swh-ro
cls: cassandra
consistency_level: LOCAL_QUORUM
hosts:
- cassandra1.internal.staging.swh.network
- cassandra2.internal.staging.swh.network
- cassandra3.internal.staging.swh.network
keyspace: swh
journal:
brokers:
- journal2.internal.staging.swh.network:9094
cls: kafka
group_id: swh-archive-stg-objstorage
message.max.bytes: 524288000
on_eof: restart
prefix: swh.journal.objects
sasl.mechanism: SCRAM-SHA-512
sasl.password: ${BROKER_USER_PASSWORD}
sasl.username: swh-archive-stg
security.protocol: SASL_SSL
objstorage:
cls: remote
url: http://objstorage-multiplexer-read-write-rpc-ingress
# Source: swh/templates/scrubber/objstorage-checker-deployment.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
name: scrubber-objstoragechecker-contents
namespace: swh-cassandra
labels:
app: scrubber-objstoragechecker-contents
spec:
revisionHistoryLimit: 2
replicas: 2
selector:
matchLabels:
app: scrubber-objstoragechecker-contents
strategy:
type: RollingUpdate
rollingUpdate:
maxSurge: 1
template:
metadata:
labels:
app: scrubber-objstoragechecker-contents
annotations:
# Force a rollout upgrade if the configuration changes
checksum/config: c40a188fe6483fb0bebe9213563fc91fbce1d58ae3c92cfc1bad063a875ece8a
spec:
affinity:
nodeAffinity:
requiredDuringSchedulingIgnoredDuringExecution:
nodeSelectorTerms:
- matchExpressions:
- key: swh/scrubber
operator: In
values:
- "true"
priorityClassName: swh-cassandra-background-workload
initContainers:
- name: prepare-configuration
image: "debian:bullseye"
imagePullPolicy: IfNotPresent
env:
- name: BROKER_USER_PASSWORD
valueFrom:
secretKeyRef:
key: BROKER_USER_PASSWORD
name: swh-archive-broker-secret
optional: false
- name: CASSANDRA_PASSWORD
valueFrom:
secretKeyRef:
key: cassandra-swh-ro-password
name: common-secrets
optional: false
- name: SCRUBBER_POSTGRESQL_PASSWORD
valueFrom:
secretKeyRef:
key: postgres-swh-scrubber-password
name: swh-scrubber-postgresql-common-secret
optional: false
command:
- /bin/bash
args:
- "-c"
- "eval echo "\"$(</etc/swh/configuration-template/config.yml.template)\"" > /etc/swh/config.yml"
volumeMounts:
- name: configuration
mountPath: /etc/swh
- name: configuration-template
mountPath: /etc/swh/configuration-template
- name: check-scrubber-migration
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
command:
- /entrypoints/check-scrubber-db-version.sh
env:
- name: MODULE
value: scrubber
volumeMounts:
- name: configuration
mountPath: /etc/swh
- name: database-utils
mountPath: /entrypoints
- name: check-objstorage-migration
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
command:
- /entrypoints/check-objstorage-db-version.sh
env:
- name: MODULE
value: objstorage
volumeMounts:
- name: configuration
mountPath: /etc/swh
- name: database-utils
mountPath: /entrypoints
containers:
- name: storage-checker
resources:
requests:
memory: 200Mi
cpu: 400m
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
imagePullPolicy: IfNotPresent
command:
- /opt/swh/entrypoint.sh
args:
- swh
- scrubber
- check
- run
- objstorage-contents
env:
- name: STATSD_HOST
value: prometheus-statsd-exporter
- name: STATSD_PORT
value: 9125
- name: STATSD_TAGS
value: "deployment:scrubber-objstoragechecker-contents"
- name: MAX_TASKS_PER_CHILD
value: 1
- name: SWH_LOG_LEVEL
value: INFO
- name: SWH_CONFIG_FILENAME
value: /etc/swh/config.yml
- name: SWH_SENTRY_ENVIRONMENT
value: staging
- name: SWH_MAIN_PACKAGE
value: swh.scrubber
- name: SWH_SENTRY_DSN
valueFrom:
secretKeyRef:
name: common-secrets
key: scrubber-sentry-dsn
# 'name' secret must exist & include key "host"
optional: false
volumeMounts:
- name: configuration
mountPath: /etc/swh
volumes:
- name: configuration
emptyDir: {}
- name: configuration-template
configMap:
name: scrubber-objstoragechecker-contents-template
defaultMode: 0777
items:
- key: config.yml.template
path: config.yml.template
- name: database-utils
configMap:
name: database-utils
defaultMode: 0555
------------- diff for environment staging namespace swh-cassandra-next-version -------------
_ __ __
_| |_ _ / _|/ _| between /tmp/swh-chart.swh.cC9GqilE/staging-swh-cassandra-next-version.before, 149 documents
/ _' | | | | |_| |_ and /tmp/swh-chart.swh.cC9GqilE/staging-swh-cassandra-next-version.after, 149 documents
| (_| | |_| | _| _|
\__,_|\__, |_| |_| returned no differences
|___/
------------- diff for environment production namespace swh -------------
_ __ __
_| |_ _ / _|/ _| between /tmp/swh-chart.swh.cC9GqilE/production-swh.before, 411 documents
/ _' | | | | |_| |_ and /tmp/swh-chart.swh.cC9GqilE/production-swh.after, 411 documents
| (_| | |_| | _| _|
\__,_|\__, |_| |_| returned six differences
|___/
spec.template.spec.containers (apps/v1/Deployment/swh/scrubber-storagechecker-primary-directory-hashes)
- one list entry removed:
- name: strorage-checker
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
imagePullPolicy: IfNotPresent
command:
- /opt/swh/entrypoint.sh
args:
- swh
- scrubber
- check
- run
- storage-primary-hashes-directory
resources:
requests:
memory: 100Mi
cpu: 100m
volumeMounts:
- name: configuration
mountPath: /etc/swh
env:
- name: STATSD_HOST
value: prometheus-statsd-exporter
- name: STATSD_PORT
value: 9125
- name: STATSD_TAGS
value: "deployment:scrubber-storagechecker-primary-directory-hashes"
- name: MAX_TASKS_PER_CHILD
value: 1
- name: SWH_LOG_LEVEL
value: INFO
- name: SWH_CONFIG_FILENAME
value: /etc/swh/config.yml
- name: SWH_SENTRY_ENVIRONMENT
value: production
- name: SWH_MAIN_PACKAGE
value: swh.scrubber
- name: SWH_SENTRY_DSN
valueFrom:
secretKeyRef:
name: common-secrets
key: scrubber-sentry-dsn
# 'name' secret must exist & include key "host"
optional: false
+ one list entry added:
- name: storage-checker
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
imagePullPolicy: IfNotPresent
command:
- /opt/swh/entrypoint.sh
args:
- swh
- scrubber
- check
- run
- storage-primary-hashes-directory
resources:
requests:
memory: 100Mi
cpu: 100m
volumeMounts:
- name: configuration
mountPath: /etc/swh
env:
- name: STATSD_HOST
value: prometheus-statsd-exporter
- name: STATSD_PORT
value: 9125
- name: STATSD_TAGS
value: "deployment:scrubber-storagechecker-primary-directory-hashes"
- name: MAX_TASKS_PER_CHILD
value: 1
- name: SWH_LOG_LEVEL
value: INFO
- name: SWH_CONFIG_FILENAME
value: /etc/swh/config.yml
- name: SWH_SENTRY_ENVIRONMENT
value: production
- name: SWH_MAIN_PACKAGE
value: swh.scrubber
- name: SWH_SENTRY_DSN
valueFrom:
secretKeyRef:
name: common-secrets
key: scrubber-sentry-dsn
# 'name' secret must exist & include key "host"
optional: false
spec.template.spec.containers (apps/v1/Deployment/swh/scrubber-storagechecker-primary-directory-references)
- one list entry removed:
- name: strorage-checker
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
imagePullPolicy: IfNotPresent
command:
- /opt/swh/entrypoint.sh
args:
- swh
- scrubber
- check
- run
- storage-primary-references-directory
resources:
requests:
memory: 100Mi
cpu: 100m
volumeMounts:
- name: configuration
mountPath: /etc/swh
env:
- name: STATSD_HOST
value: prometheus-statsd-exporter
- name: STATSD_PORT
value: 9125
- name: STATSD_TAGS
value: "deployment:scrubber-storagechecker-primary-directory-references"
- name: MAX_TASKS_PER_CHILD
value: 1
- name: SWH_LOG_LEVEL
value: INFO
- name: SWH_CONFIG_FILENAME
value: /etc/swh/config.yml
- name: SWH_SENTRY_ENVIRONMENT
value: production
- name: SWH_MAIN_PACKAGE
value: swh.scrubber
- name: SWH_SENTRY_DSN
valueFrom:
secretKeyRef:
name: common-secrets
key: scrubber-sentry-dsn
# 'name' secret must exist & include key "host"
optional: false
+ one list entry added:
- name: storage-checker
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
imagePullPolicy: IfNotPresent
command:
- /opt/swh/entrypoint.sh
args:
- swh
- scrubber
- check
- run
- storage-primary-references-directory
resources:
requests:
memory: 100Mi
cpu: 100m
volumeMounts:
- name: configuration
mountPath: /etc/swh
env:
- name: STATSD_HOST
value: prometheus-statsd-exporter
- name: STATSD_PORT
value: 9125
- name: STATSD_TAGS
value: "deployment:scrubber-storagechecker-primary-directory-references"
- name: MAX_TASKS_PER_CHILD
value: 1
- name: SWH_LOG_LEVEL
value: INFO
- name: SWH_CONFIG_FILENAME
value: /etc/swh/config.yml
- name: SWH_SENTRY_ENVIRONMENT
value: production
- name: SWH_MAIN_PACKAGE
value: swh.scrubber
- name: SWH_SENTRY_DSN
valueFrom:
secretKeyRef:
name: common-secrets
key: scrubber-sentry-dsn
# 'name' secret must exist & include key "host"
optional: false
spec.template.spec.containers (apps/v1/Deployment/swh/scrubber-storagechecker-secondary-directory-hashes)
- one list entry removed:
- name: strorage-checker
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
imagePullPolicy: IfNotPresent
command:
- /opt/swh/entrypoint.sh
args:
- swh
- scrubber
- check
- run
- storage-secondary-hashes-directory
resources:
requests:
memory: 100Mi
cpu: 100m
volumeMounts:
- name: configuration
mountPath: /etc/swh
env:
- name: STATSD_HOST
value: prometheus-statsd-exporter
- name: STATSD_PORT
value: 9125
- name: STATSD_TAGS
value: "deployment:scrubber-storagechecker-secondary-directory-hashes"
- name: MAX_TASKS_PER_CHILD
value: 1
- name: SWH_LOG_LEVEL
value: INFO
- name: SWH_CONFIG_FILENAME
value: /etc/swh/config.yml
- name: SWH_SENTRY_ENVIRONMENT
value: production
- name: SWH_MAIN_PACKAGE
value: swh.scrubber
- name: SWH_SENTRY_DSN
valueFrom:
secretKeyRef:
name: common-secrets
key: scrubber-sentry-dsn
# 'name' secret must exist & include key "host"
optional: false
+ one list entry added:
- name: storage-checker
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
imagePullPolicy: IfNotPresent
command:
- /opt/swh/entrypoint.sh
args:
- swh
- scrubber
- check
- run
- storage-secondary-hashes-directory
resources:
requests:
memory: 100Mi
cpu: 100m
volumeMounts:
- name: configuration
mountPath: /etc/swh
env:
- name: STATSD_HOST
value: prometheus-statsd-exporter
- name: STATSD_PORT
value: 9125
- name: STATSD_TAGS
value: "deployment:scrubber-storagechecker-secondary-directory-hashes"
- name: MAX_TASKS_PER_CHILD
value: 1
- name: SWH_LOG_LEVEL
value: INFO
- name: SWH_CONFIG_FILENAME
value: /etc/swh/config.yml
- name: SWH_SENTRY_ENVIRONMENT
value: production
- name: SWH_MAIN_PACKAGE
value: swh.scrubber
- name: SWH_SENTRY_DSN
valueFrom:
secretKeyRef:
name: common-secrets
key: scrubber-sentry-dsn
# 'name' secret must exist & include key "host"
optional: false
spec.template.spec.containers (apps/v1/Deployment/swh/scrubber-storagechecker-secondary-directory-references)
- one list entry removed:
- name: strorage-checker
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
imagePullPolicy: IfNotPresent
command:
- /opt/swh/entrypoint.sh
args:
- swh
- scrubber
- check
- run
- storage-secondary-references-directory
resources:
requests:
memory: 100Mi
cpu: 100m
volumeMounts:
- name: configuration
mountPath: /etc/swh
env:
- name: STATSD_HOST
value: prometheus-statsd-exporter
- name: STATSD_PORT
value: 9125
- name: STATSD_TAGS
value: "deployment:scrubber-storagechecker-secondary-directory-references"
- name: MAX_TASKS_PER_CHILD
value: 1
- name: SWH_LOG_LEVEL
value: INFO
- name: SWH_CONFIG_FILENAME
value: /etc/swh/config.yml
- name: SWH_SENTRY_ENVIRONMENT
value: production
- name: SWH_MAIN_PACKAGE
value: swh.scrubber
- name: SWH_SENTRY_DSN
valueFrom:
secretKeyRef:
name: common-secrets
key: scrubber-sentry-dsn
# 'name' secret must exist & include key "host"
optional: false
+ one list entry added:
- name: storage-checker
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
imagePullPolicy: IfNotPresent
command:
- /opt/swh/entrypoint.sh
args:
- swh
- scrubber
- check
- run
- storage-secondary-references-directory
resources:
requests:
memory: 100Mi
cpu: 100m
volumeMounts:
- name: configuration
mountPath: /etc/swh
env:
- name: STATSD_HOST
value: prometheus-statsd-exporter
- name: STATSD_PORT
value: 9125
- name: STATSD_TAGS
value: "deployment:scrubber-storagechecker-secondary-directory-references"
- name: MAX_TASKS_PER_CHILD
value: 1
- name: SWH_LOG_LEVEL
value: INFO
- name: SWH_CONFIG_FILENAME
value: /etc/swh/config.yml
- name: SWH_SENTRY_ENVIRONMENT
value: production
- name: SWH_MAIN_PACKAGE
value: swh.scrubber
- name: SWH_SENTRY_DSN
valueFrom:
secretKeyRef:
name: common-secrets
key: scrubber-sentry-dsn
# 'name' secret must exist & include key "host"
optional: false
spec.template.spec.containers (apps/v1/Deployment/swh/scrubber-storagechecker-secondary-snapshot-hashes)
- one list entry removed:
- name: strorage-checker
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
imagePullPolicy: IfNotPresent
command:
- /opt/swh/entrypoint.sh
args:
- swh
- scrubber
- check
- run
- storage-secondary-hashes-snapshot
resources:
requests:
memory: 128Mi
cpu: 150m
volumeMounts:
- name: configuration
mountPath: /etc/swh
env:
- name: STATSD_HOST
value: prometheus-statsd-exporter
- name: STATSD_PORT
value: 9125
- name: STATSD_TAGS
value: "deployment:scrubber-storagechecker-secondary-snapshot-hashes"
- name: MAX_TASKS_PER_CHILD
value: 1
- name: SWH_LOG_LEVEL
value: INFO
- name: SWH_CONFIG_FILENAME
value: /etc/swh/config.yml
- name: SWH_SENTRY_ENVIRONMENT
value: production
- name: SWH_MAIN_PACKAGE
value: swh.scrubber
- name: SWH_SENTRY_DSN
valueFrom:
secretKeyRef:
name: common-secrets
key: scrubber-sentry-dsn
# 'name' secret must exist & include key "host"
optional: false
+ one list entry added:
- name: storage-checker
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
imagePullPolicy: IfNotPresent
command:
- /opt/swh/entrypoint.sh
args:
- swh
- scrubber
- check
- run
- storage-secondary-hashes-snapshot
resources:
requests:
memory: 128Mi
cpu: 150m
volumeMounts:
- name: configuration
mountPath: /etc/swh
env:
- name: STATSD_HOST
value: prometheus-statsd-exporter
- name: STATSD_PORT
value: 9125
- name: STATSD_TAGS
value: "deployment:scrubber-storagechecker-secondary-snapshot-hashes"
- name: MAX_TASKS_PER_CHILD
value: 1
- name: SWH_LOG_LEVEL
value: INFO
- name: SWH_CONFIG_FILENAME
value: /etc/swh/config.yml
- name: SWH_SENTRY_ENVIRONMENT
value: production
- name: SWH_MAIN_PACKAGE
value: swh.scrubber
- name: SWH_SENTRY_DSN
valueFrom:
secretKeyRef:
name: common-secrets
key: scrubber-sentry-dsn
# 'name' secret must exist & include key "host"
optional: false
spec.template.spec.containers (apps/v1/Deployment/swh/scrubber-storagechecker-secondary-snapshot-references)
- one list entry removed:
- name: strorage-checker
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
imagePullPolicy: IfNotPresent
command:
- /opt/swh/entrypoint.sh
args:
- swh
- scrubber
- check
- run
- storage-secondary-references-snapshot
resources:
requests:
memory: 128Mi
cpu: 150m
volumeMounts:
- name: configuration
mountPath: /etc/swh
env:
- name: STATSD_HOST
value: prometheus-statsd-exporter
- name: STATSD_PORT
value: 9125
- name: STATSD_TAGS
value: "deployment:scrubber-storagechecker-secondary-snapshot-references"
- name: MAX_TASKS_PER_CHILD
value: 1
- name: SWH_LOG_LEVEL
value: INFO
- name: SWH_CONFIG_FILENAME
value: /etc/swh/config.yml
- name: SWH_SENTRY_ENVIRONMENT
value: production
- name: SWH_MAIN_PACKAGE
value: swh.scrubber
- name: SWH_SENTRY_DSN
valueFrom:
secretKeyRef:
name: common-secrets
key: scrubber-sentry-dsn
# 'name' secret must exist & include key "host"
optional: false
+ one list entry added:
- name: storage-checker
image: "container-registry.softwareheritage.org/swh/infra/swh-apps/scrubber:20240604.3"
imagePullPolicy: IfNotPresent
command:
- /opt/swh/entrypoint.sh
args:
- swh
- scrubber
- check
- run
- storage-secondary-references-snapshot
resources:
requests:
memory: 128Mi
cpu: 150m
volumeMounts:
- name: configuration
mountPath: /etc/swh
env:
- name: STATSD_HOST
value: prometheus-statsd-exporter
- name: STATSD_PORT
value: 9125
- name: STATSD_TAGS
value: "deployment:scrubber-storagechecker-secondary-snapshot-references"
- name: MAX_TASKS_PER_CHILD
value: 1
- name: SWH_LOG_LEVEL
value: INFO
- name: SWH_CONFIG_FILENAME
value: /etc/swh/config.yml
- name: SWH_SENTRY_ENVIRONMENT
value: production
- name: SWH_MAIN_PACKAGE
value: swh.scrubber
- name: SWH_SENTRY_DSN
valueFrom:
secretKeyRef:
name: common-secrets
key: scrubber-sentry-dsn
# 'name' secret must exist & include key "host"
optional: false
------------- diff for environment production namespace swh-cassandra -------------
_ __ __
_| |_ _ / _|/ _| between /tmp/swh-chart.swh.cC9GqilE/production-swh-cassandra.before, 94 documents
/ _' | | | | |_| |_ and /tmp/swh-chart.swh.cC9GqilE/production-swh-cassandra.after, 94 documents
| (_| | |_| | _| _|
\__,_|\__, |_| |_| returned no differences
|___/
Edited by Antoine R. Dumont