v.25.11New Feature
Add a new argument preprocessor in text
User can now add a new argument preprocessor in text index construction. The argument is an arbitrary expression that transforms each document before tokenization. #88272 (Jimmy Aguilar Mena).Why it matters
This feature enables users to customize the text indexing process by preprocessing documents with any expression, improving flexibility in handling and indexing textual data according to specific needs.How to use it
When creating a text index, use thepreprocessor argument to specify an expression that transforms each document prior to tokenization. For example, include preprocessor = <expression> in the text index construction command.