Support custom Azure Blob Storage endpoint / endpoint suffix for sovereign clouds

[nabeelq]

Quickwit currently supports Azure Blob Storage using the following configuration:

storage:
  azure:
    account: <storage-account-name>
    access_key: <storage-account-access-key>

However, there does not appear to be a way to configure a custom Azure Blob Storage endpoint.

This makes it difficult to use Quickwit with Azure environments that do not use the default public Azure endpoints, such as Azure Government, Azure China, Azure Stack, or other Azure deployments with custom endpoints.

I'd like Quickwit to support configuring a custom Azure Blob Storage endpoint so that it can connect to Azure Blob Storage deployments outside the public Azure cloud.

I haven't found an existing configuration option that allows overriding the Azure Blob Storage endpoint in Quickwit. At the moment, the only alternative appears to be modifying Quickwit's source code to add support for custom endpoints.

Azure Blob Storage endpoints vary across Azure cloud environments. For example:

Public Azure: https://.blob.core.windows.net
Azure Government: https://.blob.core.usgovcloudapi.net
Azure China: https://.blob.core.chinacloudapi.cn

Supporting configurable Azure Blob Storage endpoints would enable Quickwit to work seamlessly across Azure sovereign clouds, Azure Stack, and other Azure deployments that expose Blob Storage through non-default endpoints.

[fmassot]

Hi @nabeelq, thanks for reporting the issue.

Do you need this feature for your company?

If if's driven by a customer or your company and if you will be able to test and validate the feature, do you want to give it a try?

[trinity-1686a]

reopening as there are concerns the current implementation will actually have auth issues
#6661 (comment)