v.24.12Improvement

Add S3 Request Settings for Backup and Restore Parsing

Official CH changelog text
Add S3 request settings http_max_fields, http_max_field_name_size, http_max_field_value_size and use them while parsing S3 API responses during making a backup or restoring. #72778 (Vitaly Baranov).
Added new S3 request settings http_max_fields, http_max_field_name_size, and http_max_field_value_size that are applied when parsing S3 API responses during backup and restore operations.

Why it matters

These settings improve the robustness and control over HTTP request parsing by limiting the number and size of HTTP header fields when interacting with S3 storage. This helps prevent parsing issues or potential denial-of-service scenarios caused by overly large or numerous HTTP headers in S3 responses during backup or restore.

How to use it

Users can configure the new settings http_max_fields, http_max_field_name_size, and http_max_field_value_size in the ClickHouse server configuration. These settings will then be applied automatically when making backups or restoring data via the S3 API.

Related resources

PreviousNext