Skip to content

catalog: stop checking the upgrade shard#35214

Draft
teskje wants to merge 1 commit intoMaterializeInc:mainfrom
teskje:remove-upgrade-shard
Draft

catalog: stop checking the upgrade shard#35214
teskje wants to merge 1 commit intoMaterializeInc:mainfrom
teskje:remove-upgrade-shard

Conversation

@teskje
Copy link
Contributor

@teskje teskje commented Feb 25, 2026

The upgrade shard was introduced because opening the catalog for reading would automatically bump the version of the catalog shard, possibly fencing out existing readers unintentionally. This doesn't happen anymore, persist shard versions now must be bumped explicitly. As a result, we don't need the upgrade shard anymore and can stop checking it.

This still leaves around an initial version check during catalog open (using the catalog shard version). This isn't required for correctness but ensures that we get a nice error rather than panicking in persist. Makes tests easier to write, though it is something we could remove if it ends up being inconvenient.

The upgrade shard was introduced because opening the catalog for reading
would automatically bump the version of the catalog shard, possibly
fencing out existing readers unintentionally. This doesn't happen
anymore, persist shard versions now must be bumped explicitly. As a
result, we don't need the upgrade shard anymore and can stop checking
it.

This still leaves around an initial version check during catalog open
(using the catalog shard version). This isn't required for correctness
but ensures that we get a nice error rather than panicking in persist.
Makes tests easier to write, though it is something we could remove if
it ends up being inconvenient.
@github-actions
Copy link

Thanks for opening this PR! Here are a few tips to help make the review process smooth for everyone.

PR title guidelines

  • Use imperative mood: "Fix X" not "Fixed X" or "Fixes X"
  • Be specific: "Fix panic in catalog sync when controller restarts" not "Fix bug" or "Update catalog code"
  • Prefix with area if helpful: compute: , storage: , adapter: , sql:

Pre-merge checklist

  • The PR title is descriptive and will make sense in the git log.
  • This PR has adequate test coverage / QA involvement has been duly considered. (trigger-ci for additional test/nightly runs)
  • If this PR includes major user-facing behavior changes, I have pinged the relevant PM to schedule a changelog post.
  • This PR has an associated up-to-date design doc, is a design doc (template), or is sufficiently small to not require a design.
  • If this PR evolves an existing $T ⇔ Proto$T mapping (possibly in a backwards-incompatible way), then it is tagged with a T-proto label.
  • If this PR will require changes to cloud orchestration or tests, there is a companion cloud PR to account for those changes that is tagged with the release-blocker label (example).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant