v.23.3Improvement

Increase Opened Files Limit in clickhouse-local for High-CPU Servers

Official CH changelog text
Increase the limit for opened files in clickhouse-local. It will be able to read from web tables on servers with a huge number of CPU cores. Do not back off reading from the URL table engine in case of too many opened files. This closes #46852. #46853 (Alexey Milovidov).
Increases the limit for opened files in clickhouse-local, allowing it to read from web tables on servers with a large number of CPU cores without failing due to too many open files.

Why it matters

This feature addresses the problem where clickhouse-local could fail or back off reading from web table engines when the number of opened files exceeded limits, especially on servers with many CPU cores. By raising the file descriptor limit, it ensures reliable reading from URL-based tables, improving stability and performance in such environments.

How to use it

The increased limit is applied internally in clickhouse-local and does not require explicit user configuration. Users can directly read from web tables in clickhouse-local on high-core-count servers without encountering file limit issues.

Related resources

PreviousNext