v.23.8Experimental Feature

Add S3Queue Table Engine for Streaming Data Import from S3 (Not Ready for Use)

Official CH changelog text
Add new table engine S3Queue for streaming data import from s3. Closes #37012. #49086 (s-kat). It is not ready to use. Do not use it.
Introduces a new table engine S3Queue designed for streaming data import directly from Amazon S3 storage.

Why it matters

The S3Queue engine aims to facilitate continuous and efficient ingestion of streaming data from S3 into ClickHouse, addressing the need for integrating cloud object storage as a real-time data source.

How to use it

Currently, the S3Queue engine is not ready for production use and should not be used. Once stable, users will be able to create tables with the S3Queue engine to stream data from S3 buckets into ClickHouse.

Related resources

PreviousNext