v.23.6Improvement

Improve Progress Bar for File/S3/HDFS/URL Table Functions and Cluster Functions

Improve the progress bar for file/s3/hdfs/url table functions by using chunk size from source data and using incremental total size counting in each thread. Fix the progress bar for *Cluster functions. This closes #47250. #51088 (Kruglov Pavel).
Enhanced the progress bar for file, S3, HDFS, and URL table functions by utilizing chunk size information from the source data and implementing incremental total size counting per thread. Fixed progress bar behavior for Cluster functions.

Why it matters

The update aims to provide more accurate and responsive progress indication when querying external data sources (file, S3, HDFS, URL) and when using Cluster functions. It solves the issue of inaccurate or unresponsive progress bars by leveraging chunk size and incremental counting, improving user experience during data loading.

How to use it

No explicit user action is required. The improvements are automatically applied to the progress bars of table functions accessing file, S3, HDFS, URL sources, and Cluster functions after updating to this ClickHouse version.