Move Parts from DiskLocal to Experimental DiskS3 in Parallel

Why it matters

The motivation behind this enhancement is to improve the efficiency and speed of moving data parts between storage disks, specifically from local storage to S3-compatible storage. By parallelizing the move operation, the system can reduce downtime and accelerate data migration processes, which is valuable for users managing large datasets and leveraging hybrid storage architectures.

How to use it

This feature is available as part of the experimental DiskS3 implementation. Users can enable and utilize it by configuring storage policies with DiskLocal and DiskS3, then performing data parts movement operations. Since it is experimental, users should test in development environments and refer to official documentation for setup details.