Staging instance, all changes can be removed at any time

Skip to content

[docker-compose] conf/objstorage: Use a higher value for client_max_size

Antoine Lambert requested to merge generated-differential-D1225-source into generated-differential-D1225-target

When trying to load a git repository from the docker-compose environment, I observed the following type of errors:

swh-loader_1                  | Traceback (most recent call last):
swh-loader_1                  |   File "/home/swh/.local/lib/python3.6/site-packages/swh/loader/core/loader.py", line 895, in load
swh-loader_1                  |     self.store_data()
swh-loader_1                  |   File "/home/swh/.local/lib/python3.6/site-packages/swh/loader/core/loader.py", line 1002, in store_data
swh-loader_1                  |     self.send_batch_contents(self.get_contents())
swh-loader_1                  |   File "/home/swh/.local/lib/python3.6/site-packages/swh/loader/core/loader.py", line 648, in send_batch_contents
swh-loader_1                  |     packet_size_bytes=packet_size_bytes)
swh-loader_1                  |   File "/home/swh/.local/lib/python3.6/site-packages/swh/loader/core/loader.py", line 41, in send_in_packets
swh-loader_1                  |     sender(formatted_objects)
swh-loader_1                  |   File "/usr/local/lib/python3.6/site-packages/retrying.py", line 49, in wrapped_f
swh-loader_1                  |     return Retrying(*dargs, **dkw).call(f, *args, **kw)
swh-loader_1                  |   File "/usr/local/lib/python3.6/site-packages/retrying.py", line 206, in call
swh-loader_1                  |     return attempt.get(self._wrap_exception)
swh-loader_1                  |   File "/usr/local/lib/python3.6/site-packages/retrying.py", line 247, in get
swh-loader_1                  |     six.reraise(self.value[0], self.value[1], self.value[2])
swh-loader_1                  |   File "/usr/local/lib/python3.6/site-packages/six.py", line 693, in reraise
swh-loader_1                  |     raise value
swh-loader_1                  |   File "/usr/local/lib/python3.6/site-packages/retrying.py", line 200, in call
swh-loader_1                  |     attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
swh-loader_1                  |   File "/home/swh/.local/lib/python3.6/site-packages/swh/loader/core/loader.py", line 401, in send_contents
swh-loader_1                  |     self.storage.content_add(content_list)
swh-loader_1                  |   File "/usr/local/lib/python3.6/site-packages/swh/storage/api/client.py", line 23, in content_add
swh-loader_1                  |     return self.post('content/add', {'content': content})
swh-loader_1                  |   File "/usr/local/lib/python3.6/site-packages/swh/core/api/__init__.py", line 185, in post
swh-loader_1                  |     return self._decode_response(response)
swh-loader_1                  |   File "/usr/local/lib/python3.6/site-packages/swh/core/api/__init__.py", line 220, in _decode_response
swh-loader_1                  |     raise pickle.loads(decode_response(response))
swh-loader_1                  | swh.core.api.RemoteException: Unexpected status code for API request: 413 (b'Maximum request body size 104857600 exceeded, actual body size 104887327')

This is due to the objstorage client_max_size configuration entry whose value is too low. So reinstate the value that was always used until the recent configuration management changes.

Migrated from D1225 (view on Phabricator)

Merge request reports