v.23.2New Feature
Support Fixed-Size Binary and Fixed-Length Byte Array Types in Arrow and Parquet
Support typesFIXED_SIZE_BINARYtype in Arrow,FIXED_LENGTH_BYTE_ARRAYinParquetand match them toFixedString. Add settingsoutput_format_parquet_fixed_string_as_fixed_byte_array/output_format_arrow_fixed_string_as_fixed_byte_arrayto control default output type for FixedString. Closes #45326. #45340 (Kruglov Pavel).
Why it matters
This feature improves compatibility and type fidelity when exporting and importing fixed-size binary data via Arrow and Parquet formats, ensuring that ClickHouse'sFixedString type is correctly matched and handled. It solves issues related to type mismatches and data interpretation during serialization and deserialization.How to use it
Users can control how theFixedString type is output by adjusting the settings output_format_parquet_fixed_string_as_fixed_byte_array and output_format_arrow_fixed_string_as_fixed_byte_array. These settings determine whether FixedString is exported as fixed-byte array types in Parquet and Arrow formats respectively.