v.23.12New Feature

Introduce http_make_head_request Setting to Support Various HTTP Servers

Introduce a new setting http_make_head_request. If it is turned off, the URL table engine will not do a HEAD request to determine the file size. This is needed to support inefficient, misconfigured, or not capable HTTP servers. #54602 (Fionera).
Introduced a new http_make_head_request setting for the URL table engine to control whether a HEAD request is sent to determine file size.

Why it matters

The setting addresses issues with inefficient, misconfigured, or incapable HTTP servers that may not handle HEAD requests properly. By disabling this request, users can avoid failures or delays when accessing files via HTTP.

How to use it

Set the http_make_head_request setting to 0 (off) to prevent the URL table engine from sending HEAD requests. This can be configured in the server settings or query context, for example:

SET http_make_head_request = 0;


This will make the engine skip the HEAD request and proceed without pre-fetching file size information.