v.20.11Improvement

Better Read Task Scheduling for JBOD Architecture with MergeTree Storage

Better read task scheduling for JBOD architecture and MergeTree storage. New setting read_backoff_min_concurrency which serves as the lower limit to the number of reading threads. #16423 (Amos Bird).
Introduces improved read task scheduling for JBOD architecture and MergeTree storage by adding the read_backoff_min_concurrency setting.

Why it matters

This feature addresses inefficiencies in read task scheduling under JBOD setups by establishing a lower bound on the number of reading threads. It helps optimize resource utilization and improves read performance and concurrency management in MergeTree tables.

How to use it

Users can enable this feature by configuring the new setting read_backoff_min_concurrency in their server or session settings to specify the minimum number of concurrent reading threads for read operations.