v.23.2New Feature

Enrichment of ReplacingMergeTree Engine for Duplicate Insertion Handling

Official CH changelog text
Enrichment of the existing ReplacingMergeTree engine to allow duplicate the insertion. It leverages the power of both ReplacingMergeTree and CollapsingMergeTree in one MergeTree engine. Deleted data are not returned when queried, but not removed from disk neither. #41005 (youennL-cs).
ReplacingMergeTree engine has been enhanced to support duplicate insertions by combining features of both ReplacingMergeTree and CollapsingMergeTree engines, enabling efficient handling of deleted data without physically removing it from disk.

Why it matters

This feature addresses the need to manage duplicate insertions and deleted records more effectively within a single MergeTree engine. It allows users to query data without seeing deleted rows while retaining those rows on disk for potential audit or recovery purposes, improving data consistency and storage management.

How to use it

Users can enable this feature by using the enhanced ReplacingMergeTree engine variant that incorporates this duplication and deletion handling behavior. Details on configuration and usage can be found in the linked pull request documentation.

Related resources

PreviousNext