v.23.5Improvement

Added Weighted Fair IO Scheduling and Dynamic Resource Management in ClickHouse

Added weighted fair IO scheduling policy. Added dynamic resource manager, which allows IO scheduling hierarchy to be updated in runtime w/o server restarts. #49671 (Sergei Trifonov).
Weighted fair IO scheduling policy and dynamic resource manager introduced. The new weighted fair IO scheduling allows prioritizing IO operations based on assigned weights. The dynamic resource manager enables updating IO scheduling hierarchies at runtime without requiring server restarts.

Why it matters

This feature addresses the need for more flexible and fair IO resource allocation in ClickHouse. It allows better control over IO bandwidth distribution among queries or users by applying weight-based scheduling. The dynamic resource manager enhances operational efficiency by enabling real-time updates to IO scheduling policies without downtime.

How to use it

To use this feature, configure the weighted fair IO scheduling policy in the resource manager settings. You can dynamically update the IO scheduling hierarchy during runtime via the ClickHouse configuration or resource manager interfaces without restarting the server.