v.22.11New Feature

Added ** glob support for recursive directory traversal in filesystem and S3

Added ** glob support for recursive directory traversal of the filesystem and S3. Resolves #36316. #42376 (SmitaRKulkarni).
Added ** glob pattern support for recursive directory traversal in ClickHouse for both local filesystem and S3 storage.

Why it matters

This feature enables users to efficiently query data stored in nested directory structures by allowing recursive matching using the ** glob pattern. It simplifies data access in deeply nested folders without specifying each path explicitly.

How to use it

Users can utilize the pattern in filesystem or S3 paths when defining table sources or when using functions that accept file path globs. For example, specifying a path like /data/logs//2024-06-01/*.parquet will include all matching files recursively under the directory tree.