Improved resilience of ClickHouse when copying files from S3 by adding a fallback mechanism to buffer copy if GCP returns an Internal Error with GATEWAY_TIMEOUT HTTP status.
Why it matters
This feature addresses reliability issues during file transfers from S3 storage when Google Cloud Platform (GCP) responds with a timeout error. By implementing a fallback to buffer copy, it ensures that data copy operations are more robust and less likely to fail due to transient gateway timeouts, improving user experience and stability.How to use it
This fallback mechanism is automatically applied when the error condition occurs during S3 file copy operations involving GCP. No additional configuration or user intervention is needed to benefit from this feature.