v.21.1Improvements
Allow User Configured HDFS Replication Parameter for DiskHDFS and StorageHDFS
Allow a user configuredhdfs_replicationparameter forDiskHDFSandStorageHDFS. Closes #32039. #32049 (leosunli).
Why it matters
This feature allows users to specify the replication factor used by HDFS when storing data viaDiskHDFS and StorageHDFS, providing better control over data redundancy and fault tolerance according to their infrastructure requirements.How to use it
To use this feature, set thehdfs_replication parameter in the configuration of DiskHDFS or StorageHDFS. This parameter determines the replication factor for HDFS storage operations, for example:<disk>
<type>hdfs</type>
<hdfs_replication>3</hdfs_replication>
...
</disk>