v.23.1Improvement

Add Option to Disable File Deduplication in BACKUP Command

Add the ability to disable deduplication of files for BACKUP (for backups without deduplication ATTACH can be used instead of full RESTORE). For example BACKUP foo TO S3(...) SETTINGS deduplicate_files=0 (default deduplicate_files=1). #43947 (Azat Khuzhin).
Added an option to disable file deduplication during BACKUP operations in ClickHouse.

Why it matters

This feature allows users to create backups without deduplicating files. It addresses scenarios where deduplication is not desired or needed, enabling faster backup processes or compatibility with specific restore workflows, such as using ATTACH instead of a full RESTORE.

How to use it

To disable deduplication during backup, include the setting deduplicate_files=0 in the BACKUP command:

BACKUP foo TO S3(...) SETTINGS deduplicate_files=0

By default, deduplication is enabled (deduplicate_files=1).