v.22.10New Feature

Add S3 as a Backup Destination Supporting As-Is Path/Data Structure

Add S3 as a new type of the destination of backups. Support BACKUP to S3 with as-is path/data structure. #42333 (Vitaly Baranov), #42232 (Azat Khuzhin).
Add S3 as a new destination type for backups, enabling backup operations to store data directly in Amazon S3 with the existing path and data structure.

Why it matters

This feature allows users to back up ClickHouse data directly to Amazon S3 storage, providing a scalable, durable, and widely-used cloud storage solution for backups. It solves the problem of integrating ClickHouse backups with cloud storage, simplifying backup management and offsite data protection.

How to use it

To use this feature, specify S3 as the backup destination in the BACKUP query and provide the appropriate S3 URL and credentials. The backup will use the existing path/data structure when storing data in S3. Example:

BACKUP TABLE my_table TO 's3://bucket_name/path/' SETTINGS s3_access_key_id='YOUR_KEY', s3_secret_access_key='YOUR_SECRET';