v.21.1Improvements

Support HDFS storage default expression and optimize column-oriented fetching

Support default expression for HDFS storage and optimize fetching when source is column oriented. #32256 (李扬).
Support default expressions for HDFS storage and optimize data fetching when the source data is column-oriented.

Why it matters

This feature allows users to define default expressions for columns stored in HDFS, enabling more flexible data manipulations and transformations. Additionally, it improves performance by optimizing data retrieval specifically for column-oriented data sources stored in HDFS.

How to use it

Users can define default expressions in the table schema when working with HDFS storage. The system will automatically apply these expressions on data fetch. For column-oriented sources, the fetching process is optimized internally, so no additional user intervention is required beyond enabling HDFS storage with the appropriate table definition.