v.21.4Improvements

DiskS3 Update: Fixed Directory Move Bug with Non-Empty Destinations

Official CH changelog text
DiskS3 (experimental feature under development). Fixed bug with the impossibility to move directory if the destination is not empty and cache disk is used. #21837 (Pavel Kovalenko).
Added support for the experimental DiskS3 storage engine in ClickHouse, along with a bug fix enabling directory moves to non-empty destinations when using cache disks.

Why it matters

This feature introduces DiskS3 as an experimental disk type, allowing ClickHouse to use Amazon S3-compatible storage for data storage. Additionally, it fixes a bug that prevented moving directories when the destination directory was not empty and cache disks were involved, improving reliability and flexibility in storage management.

How to use it

To use DiskS3, enable the experimental feature in your ClickHouse configuration by defining a disk of type DiskS3 with the appropriate S3 credentials and bucket information. The bug fix is applied automatically with this update, allowing directory moves on cache disks without additional configuration.

Related resources

PreviousNext