v.25.12Improvement

Avoid getting DB::Exception: apache::thrift::transport::TTransportException: MaxMessageSize reached

Official CH changelog text
Set max message size on parquet v3 reader to avoid getting DB::Exception: apache::thrift::transport::TTransportException: MaxMessageSize reached. #91737 (Arthur Passos).
Set a maximum message size limit for the Parquet V3 reader to prevent errors related to exceeding allowable message sizes.

Why it matters

This feature addresses the issue where reading Parquet V3 files could result in a DB::Exception caused by apache::thrift::transport::TTransportException: MaxMessageSize reached. By enforcing a max message size, it prevents such exceptions, improving the stability and reliability of Parquet file reading in ClickHouse.

How to use it

The max message size is set internally by the Parquet V3 reader. Users do not need to manually configure this setting unless exposed via configuration later. Simply use the Parquet V3 reader as usual and the limit will help avoid the MaxMessageSize reached error.

Related resources

PreviousNext