Allow Kafka Error Publishing to Virtual Column in ClickHouse

Why it matters

This feature allows users to handle and analyze messages that cause errors during Kafka consumption by exposing error details as a virtual column. It helps in debugging and managing problematic Kafka messages without losing data, improving observability and error handling for Kafka-integrated ClickHouse tables.

How to use it

Enable the feature by setting the kafka_handle_error_mode setting to a desired value that activates publishing Kafka error details. Once enabled, error information will be available in a dedicated virtual column within the Kafka engine's table, which can be queried directly.