Skip to content

[Azure Blobs] Forward chunk_size in download_object_as_stream#2169

Open
Sanjays2402 wants to merge 1 commit into
apache:trunkfrom
Sanjays2402:fix/1698-azure-chunk-size
Open

[Azure Blobs] Forward chunk_size in download_object_as_stream#2169
Sanjays2402 wants to merge 1 commit into
apache:trunkfrom
Sanjays2402:fix/1698-azure-chunk-size

Conversation

@Sanjays2402

Copy link
Copy Markdown
Contributor

[Azure Blobs] Forward chunk_size in download_object_as_stream

Description

Closes #1698. download_object_as_stream and download_object_range_as_stream in the Azure Blobs driver passed the hardcoded AZURE_DOWNLOAD_CHUNK_SIZE to iter_content instead of the caller's chunk_size, so a requested size was silently ignored. Both now forward chunk_size (falling back to the default when None), matching the S3 driver's behavior.

Status

  • done, ready for review

Checklist (tick everything that applies)

  • Code linting (required, can be done after the PR checks)
  • Documentation
  • Tests
  • ICLA (required for bigger changes)

download_object_as_stream and download_object_range_as_stream passed the
hardcoded AZURE_DOWNLOAD_CHUNK_SIZE to iter_content instead of the
caller's chunk_size, so a requested size was silently ignored. Forward
chunk_size (falling back to the default when None), matching the S3
driver. Adds a regression test covering both methods.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

download_object_as_stream for Azure (azure_blobs.py) silently ignores caller's chunk_size without raising an exception.

1 participant