v.21.1Improvements

Improve Skipping Unknown Fields in Template/CustomSeparated Formats

Improve skipping unknown fields with quoted escaping rule in Template/CustomSeparated formats. Previously you could skip only quoted strings, now you can skip values with any type. #32204 (Kruglov Pavel).
Enhanced skipping of unknown fields in Template and CustomSeparated formats by supporting quoted escaping rules for values of any type, not just quoted strings.

Why it matters

This feature improves data parsing flexibility by allowing ClickHouse to skip unknown fields more robustly when using Template or CustomSeparated input formats. Previously, only quoted strings could be skipped correctly, limiting handling of diverse data types. Now, values of any type can be skipped, reducing errors and increasing resilience when processing semi-structured or loosely defined input data.

How to use it

Use Template or CustomSeparated input formats as usual. The improved skipping mechanism with quoted escaping is applied automatically when parsing input data with unknown fields, requiring no additional configuration from the user.