v.23.7New Feature

Support async_deduplication_token for async insert

Support async_deduplication_token for async insert. #52136 (Han Fei).
Added support for async_deduplication_token in asynchronous inserts in ClickHouse.

Why it matters

This feature solves the problem of duplicate data during asynchronous insert operations by enabling a token-based deduplication mechanism. It ensures data consistency and prevents repeated entries when inserts are retried or reprocessed.

How to use it

To use this feature, specify the async_deduplication_token parameter in your asynchronous insert queries. This token uniquely identifies the insert operation, allowing ClickHouse to detect and discard duplicate inserts automatically.