Fix race condition in HDFS, S3, and URL storage engines

Fix rare and benign race condition in HDFS, S3 and URL storage engines which can lead to additional connections. #34172 (alesapin).