v.24.2New Feature

Detect File Format Automatically During Schema Inference in Various Engines

Try to detect file format automatically during schema inference if it's unknown in file/s3/hdfs/url/azureBlobStorage engines. Closes #50576. #59092 (Kruglov Pavel).
Automatically detect the file format during schema inference for external table engines such as file, s3, hdfs, url, and azureBlobStorage when the format is unknown.

Why it matters

This feature addresses the problem of requiring users to explicitly specify file formats when loading data through external engines. By automatically detecting the file format during schema inference, it simplifies data ingestion workflows, reduces configuration errors, and improves user experience.

How to use it

When using external table engines like file, s3, hdfs, url, or azureBlobStorage, omit the file format in the table definition or query. ClickHouse will attempt to automatically detect the file format during schema inference, enabling seamless data loading without manual format specification.