v.22.7New Feature

Add zstd_window_log_max Setting for Memory Control in Zstd Decoding

Add a setting zstd_window_log_max to configure max memory usage on zstd decoding when importing external files. Closes #35693. #37015 (wuxiaobai24).
Added the zstd_window_log_max setting to control the maximum memory usage for Zstandard (zstd) decoding during the import of external files in ClickHouse.

Why it matters

This feature addresses the need to limit memory consumption when decoding zstd compressed data during file imports. By setting a maximum limit on the zstd decoding window size, users can prevent excessive memory usage, improving stability and resource management during data ingestion.

How to use it

Users can enable and configure the maximum memory usage for zstd decoding by setting the zstd_window_log_max parameter in their ClickHouse configuration or session settings before importing external files.