Repository navigation

perf(thrift): prefetch CloudFetch links while earlier files download - #1038

Open

vuanhphung wants to merge 17 commits into

perf/thrift-cf-batchfrom

perf/thrift-cf-prefetch

Open

perf(thrift): prefetch CloudFetch links while earlier files download#1038
vuanhphung wants to merge 17 commits into
perf/thrift-cf-batchfrom
perf/thrift-cf-prefetch

Commits on Nov 12, 2026
- perf(thrift): prefetch CloudFetch links while earlier files download
  
  vuanhphung
  and
  Isaac
  committed
  9c6cb9e
- Guard prefetched link fetches and a shut-down queue
  
  vuanhphung
  and
  Isaac
  committed
  117a095
- Don't re-poll for links when a reply only had empty links
  
  vuanhphung
  and
  Isaac
  committed
  0dede5d
- Stop scheduling if the manager is shut down during a link fetch
  
  vuanhphung
  and
  Isaac
  committed
  e114c48
- Accept string values for _cloudfetch_prefetch
  
  vuanhphung
  and
  Isaac
  committed
  5ef9b34
- Make CloudFetch cancellation stop downloads in flight
  
  vuanhphung
  and
  Isaac
  committed
  6512820
- Stop downloads even if the cancel request fails
  
  vuanhphung
  and
  Isaac
  committed
  a86a609
- After cancel, still return files that finished downloading
  
  vuanhphung
  and
  Isaac
  committed
  e1ce857
- Re-check cancellation and link expiry before a retried GET
  
  vuanhphung
  and
  Isaac
  committed
  30aaac3
- Make a failed mid-stream link fetch fail every later read
  
  vuanhphung
  and
  Isaac
  committed
  a2643e8
- Back off between body-read retries; chain the stored link error
  
  vuanhphung
  and
  Isaac
  committed
  181cb82
- Treat _cloudfetch_prefetch=None as unset
  
  vuanhphung
  and
  Isaac
  committed
  8d86434
- Warn on unrecognized _cloudfetch_prefetch strings; time only the last attempt
  
  vuanhphung
  and
  Isaac
  committed
  779182a
- Stop downloads when a mid-stream link fetch fails
  
  vuanhphung
  and
  Isaac
  committed
  66eeda5
- Turn prefetch off for unrecognized _cloudfetch_prefetch strings
  
  vuanhphung
  and
  Isaac
  committed
  677f4bc
- Reject row-based replies in fetch_result_links too
  
  vuanhphung
  and
  Isaac
  committed
  6e14f55
- Keep returning downloaded files after a failed link fetch
  
  vuanhphung
  and
  Isaac
  committed
  a83f50f

Commits

Commits on Nov 12, 2026