v.24.1New Feature
Add Settings for ZSTD Compression Level and Window Size in Output Methods
Add two settingsoutput_format_compression_levelto change output compression level andoutput_format_compression_zstd_window_logto explicitly set compression window size and enable long-range mode for zstd compression if output compression method iszstd. Applied forINTO OUTFILEand when writing to table functionsfile,url,hdfs,s3, andazureBlobStorage. #58539 (Duc Canh Le).
Why it matters
These settings provide users with finer control over compression parameters when outputting data. They enable adjustment of the compression level and explicit setting of the zstd compression window size, including the activation of long-range mode. This allows for better compression efficiency and performance tuning when exporting data usingINTO OUTFILE or writing to table functions like file, url, hdfs, s3, and azureBlobStorage.How to use it
Users can setoutput_format_compression_level to specify the desired compression level for output formats. When using zstd compression, output_format_compression_zstd_window_log can be set to define the compression window size and enable long-range mode. These settings apply automatically when using INTO OUTFILE or writing data through the supported table functions.