v.21.10New Features

Added Executable Storage Engine and Table Function for Streaming Data Processing

Added Executable storage engine and executable table function. It enables data processing with external scripts in streaming fashion. #28102 (Maksim Kita) (ruct).
Added the Executable storage engine and the executable table function, enabling data processing using external scripts in a streaming manner.

Why it matters

This feature allows users to integrate external script processing directly within ClickHouse queries, providing a flexible way to handle data transformations or integrations that require custom or external logic, improving extensibility and streamlining workflows.

How to use it

Users can create tables with the Executable storage engine or call the executable table function specifying the external script to run. The data flows through these external scripts in a streaming fashion, enabling real-time processing without intermediate storage.