v.22.10Improvement

ClickHouse Timeout Issues During Large Multipart Uploads to Minio

Official CH changelog text
When uploading big parts to Minio, 'Complete Multipart Upload' can take a long time. Minio sends heartbeats every 10 seconds (see https://github.com/minio/minio/pull/7198). But clickhouse times out earlier, because the default send/receive timeout is set to 5 seconds. #42321 (filimonov).
Increased S3 send/receive timeout to prevent premature timeouts during large multipart uploads to Minio.

Why it matters

When uploading large parts to Minio using multipart upload, the Complete Multipart Upload operation can take longer than the default timeout. Minio sends heartbeats every 10 seconds to keep the connection alive, but ClickHouse's default 5-second timeout caused premature disconnections and failures. This feature aligns ClickHouse's timeout settings with Minio's heartbeat interval, preventing timeouts and improving reliability of large multipart uploads.

How to use it

This feature automatically adjusts the send/receive timeout for S3-compatible storage clients like Minio to exceed 10 seconds, matching Minio's heartbeat interval. Users do not need to manually configure timeouts unless they want to customize this behavior further in their ClickHouse server configuration.

Related resources

PreviousNext