Account Failed Files in StorageS3Queue Settings

Why it matters

This feature introduces tracking and limiting of failed files in StorageS3Queue by leveraging the s3queue_tracked_file_ttl_sec and s3queue_traked_files_limit settings. It helps users better manage resource usage and reliability by controlling how long failed files are tracked and limiting the number of such files, preventing excessive accumulation and potential performance degradation.

How to use it

Users can configure this feature by setting the parameters s3queue_tracked_file_ttl_sec (to define the TTL in seconds for tracking failed files) and s3queue_traked_files_limit (to limit the maximum number of tracked failed files) in their StorageS3Queue table settings or server configuration.