v.24.5New Feature

S3 Storage Now Supports Iterating Files in Archive Formats

Official CH changelog text
Earlier our S3 storage and s3 table function didn't support selecting from archive container files, such as tarballs, zip, 7z. Now they allow to iterate over files inside archives in S3. #62259 (Daniil Ivanik).
ClickHouse now supports reading files stored inside archive containers (such as tarballs, zip, and 7z) directly from S3 storage and through the s3 table function.

Why it matters

This feature enables users to query data stored within compressed archive files on S3 without manually extracting them first, simplifying data access workflows and improving efficiency when working with archived datasets.

How to use it

To use this feature, configure the s3 table function or S3 storage with a path to an archive file stored on S3. ClickHouse will automatically iterate over the files inside the archive and allow querying their contents directly.

Related resources

PreviousNext