Skip to content

The Rust cache stops paying for uploads R2 refuses - #8763

Draft
kixelated wants to merge 3 commits into
mainfrom
quest/m0/ci/mbx-failed-puts
Draft

kixelated wants to merge 3 commits into
mainfrom
quest/m0/ci/mbx-failed-puts

Conversation

@kixelated

@kixelated kixelated commented Nov 14, 2026 •

Copy link
Copy Markdown
Collaborator

Records the first scheduled Nightly after #8631's MBX_GC_MAX_SIZE=20GiB and plans the mbx bump that adopts upstream's fix. No CI change: the quest stays open for the second night and that release.

Results (Nightly 43601796176 vs 43250182795, same 12 h window)

  • PutObject 163,302 → 131,293 (−20%); 412s 151,043 → 86,387 (−43%).
  • Hits rose in 24 of 38 Rust-cache jobs (doctest 165 → 421), misses fell in 29.
  • 20 Linux jobs still spend the full 20 GiB, nearly all on prefetch, and 25 still log "cached action is missing blob".
  • 12 jobs lost hits, mostly to hundreds of "not looked up" units (features, x11, moxygen, Rust bench targets), a cause the budget does not explain; noted in the Plan to investigate.
  • Upstream merged jdx/mr-boxington#951 (prefetch capped at half the budget), not yet released.

Waiting

  • GitHub Actions: the 2026-11-15 Nightly confirms these numbers.
  • jdx/mr-boxington: a release with require_equals #951.

Decisions

  • Hosted budget: ✅ keep 20 GiB (rejected: raise it now). Maintainer, 2026-11-14.
  • mbx-prefetch-cap: ✅ keep in m0 (rejected: move to m4, drop it). Maintainer, 2026-11-14.

Follow-ups

Validation

Counts from Cloudflare GraphQL r2OperationsAdaptiveGroups (bucket mbx-moq-dev) and every job log's mbx[cache] summary for both runs, tallied by script. quest check passes. Nothing posted upstream.

Public API: none. Wire: none.

Caused by

None: measurement only.

Models

Size: S
Implementer: Claude Code, claude-opus-5-5, unknown effort

🤖 Generated with Claude Code

Review

Rewritten by quest review after each round.

  • Head: 2b797b4

  • Base: origin/main at 73ce9d9

  • Reviewer: Codex, gpt-6.1-sol, medium effort

  • Session: 01a1dba3-26ad-7770-ab78-3707ade0a424, round 2

  • Score: 10/10, The incremental changes consistently document the maintainer’s budget and priority decisions, with no actionable defects.

  • Rounds: 2; findings 0: fixed 0, refuted 0, open 0

  • Findings: none

kixelated and others added 3 commits November 14, 2026 11:54
…he prefetch-cap bump

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant