v.25.10Improvement

Make bucket lock in S3Queue ordered mode

Official CH changelog text
Make bucket lock in S3Queue ordered mode a persistent mode, similar to processing nodes in case use_persistent_processing_nodes = 1. Add keeper fault injection in tests. #86628 (Kseniia Sumarokova).
Make bucket lock in S3Queue ordered mode persistent, similar to processing nodes when use_persistent_processing_nodes = 1 is enabled.

Why it matters

This feature enhances the reliability of S3Queue in ordered mode by making the bucket lock persistent. It prevents multiple consumers from concurrently processing the same bucket, reducing race conditions and improving fault tolerance during queue processing.

How to use it

Enable the persistent bucket lock in S3Queue ordered mode by setting the setting use_persistent_processing_nodes = 1.

Related resources

PreviousNext