v.23.9New Feature

Allow S3-style URLs for table functions with automatic HTTP conversion

Official CH changelog text
Allow S3-style URLs for table functions s3, gcs, oss. URL is automatically converted to HTTP. Example: 's3://clickhouse-public-datasets/hits.csv' is converted to 'https://clickhouse-public-datasets.s3.amazonaws.com/hits.csv'. #54931 (Yarik Briukhovetskyi).
Support for using S3-style URLs in ClickHouse table functions s3, gcs, and oss by automatically converting them to HTTP URLs.

Why it matters

This feature simplifies the way external cloud storage paths are specified in ClickHouse by allowing users to write familiar S3-style URLs (e.g., s3://bucket/key) directly. The system automatically converts these to the corresponding HTTP URLs, improving usability and reducing configuration errors when accessing data on cloud storage services.

How to use it

Users can provide S3-style URLs directly in the s3, gcs, or oss table functions. For example, use 's3://clickhouse-public-datasets/hits.csv' as a path argument, which ClickHouse will internally convert to the proper HTTP URL format: 'https://clickhouse-public-datasets.s3.amazonaws.com/hits.csv'.

Related resources

PreviousNext