v.23.10Improvement

Set Limit for Max Configuration Value of queued.min.messages in Kafka

Set limit of the maximum configuration value for queued.min.messages to avoid problem with start fetching data with Kafka. #56121 (Stas Morozov).
Set a maximum limit on the queued.min.messages configuration parameter for Kafka integration in ClickHouse to prevent issues when starting data fetching.

Why it matters

This feature addresses problems that occur during the initial data fetch from Kafka when the queued.min.messages setting is too high. By imposing a maximum limit, it ensures more stable and reliable startup behavior for Kafka consumers in ClickHouse.

How to use it

Users should configure the queued.min.messages parameter as usual for Kafka table engines, but keep in mind that values exceeding the new maximum limit will be restricted automatically to avoid startup issues.