v.21.11Improvements

Implement max_suspicious_broken_parts_bytes Setting for MergeTree

Implement max_suspicious_broken_parts_bytes setting for MergeTree (to limit total size of all broken parts, default is 1GiB). #28707 (Azat Khuzhin).
Implemented the max_suspicious_broken_parts_bytes setting for MergeTree tables to limit the total size of all broken parts, with a default value of 1GiB.

Why it matters

This feature helps prevent excessive accumulation of broken parts in MergeTree tables by setting a cap on their combined size. It improves cluster stability and data integrity by controlling resource usage related to broken parts.

How to use it

Set the max_suspicious_broken_parts_bytes parameter in the server or table configuration to specify the maximum allowed total size of broken parts. By default, it is set to 1GiB. Adjust this value according to your needs to control broken parts storage.