Flush Parts of Right-hand Joining Table on Disk in Partialmergejoin (if There Is Not Enough Memory)

Why it matters

This feature addresses memory limitations during PartialMergeJoin operations by temporarily storing parts of the right-hand table on disk. It allows joins with larger datasets without running out of memory, improving stability and scalability for resource-constrained environments.

How to use it

The flushing mechanism in PartialMergeJoin is automatic and activates when memory usage surpasses configured thresholds. Users do not need to manually enable it; ensuring adequate disk space for temporary storage is recommended.