v.23.2Improvement

Column Splits for File Processing in ClickHouse

Official CH changelog text
The column num_processed_files was split into two columns: num_files (for BACKUP) and files_read (for RESTORE). The column processed_files_size was split into two columns: total_size (for BACKUP) and bytes_read (for RESTORE). #45800 (Vitaly Baranov).
The metrics related to file processing during BACKUP and RESTORE operations have been split into dedicated columns for better clarity and accuracy.

Why it matters

Previously, the single columns num_processed_files and processed_files_size were used to track file counts and sizes for both BACKUP and RESTORE operations, which could cause confusion and mixed values. Splitting these into separate columns (num_files and total_size for BACKUP; files_read and bytes_read for RESTORE) improves monitoring and diagnostics by clearly distinguishing between backup and restore metrics.

How to use it

Users will now see distinct columns (num_files, total_size, files_read, bytes_read) in system tables or logs related to BACKUP and RESTORE operations automatically. No additional configuration is required to benefit from this separation; it improves observability out of the box.

Related resources

PreviousNext