Skip to content

parallel membership checks and serialized rollout waits failures - #229

Merged
alicefr merged 2 commits into
bootc-dev:mainfrom
HarshwardhanPatil07:fix-controller-membership-node-filter
Oct 12, 2026
Merged

alicefr merged 2 commits into
bootc-dev:mainfrom
HarshwardhanPatil07:fix-controller-membership-node-filter

Conversation

@HarshwardhanPatil07

@HarshwardhanPatil07 HarshwardhanPatil07 commented Oct 12, 2026 •

Copy link
Copy Markdown
Member

Parallel E2E tests can create daemon pods on multiple nodes. Scope TestControllerMembership's pod lookup to its own node while retaining the exactly-one-running-pod assertion.

TestMidRolloutImageChange permits one reboot at a time but waited in node creation order. When the queued node came first, its eight-minute completion window included waiting for the other node to finish two image transitions. Wait for the already-rebooting node first, then the queued node. Keep the per-node timeout, final-image assertions, and exactly-one-reboot check unchanged.

TestControllerMembership but timed out in the mid-rollout test on Kubernetes 1.35 and 1.36.

Ref: #228

Parallel E2E tests create daemon pods on other managed nodes. Restrict the membership lookup to its own node so unrelated pods do not cause the exactly-one assertion to time out.

Refs: bootc-dev#226
Refs: bootc-dev#203

Assisted-by: AI
Signed-off-by: HarshwardhanPatil07 <harshpat@redhat.com>
@HarshwardhanPatil07
HarshwardhanPatil07 force-pushed the fix-controller-membership-node-filter branch from a18fd2b to 2a44785 Compare October 12, 2026 08:34
The rollout permits one reboot at a time. Waiting in node creation order can spend the queued node’s completion budget on the first node finishing two image transitions. Wait for the already-rebooting node first so the queued node receives its own bounded completion window.

Keep the eight-minute per-node timeout, final-image checks, and exactly-one-reboot assertion unchanged. CI must confirm recovery; transient networking errors alone do not establish a permanent failure.

Refs: bootc-dev#229

Assisted-by: AI
Signed-off-by: HarshwardhanPatil07 <harshpat@redhat.com>
@HarshwardhanPatil07 HarshwardhanPatil07 changed the title Scope membership daemon lookup to its node e2e: Fix parallel membership checks and serialized rollout waits Oct 12, 2026
@HarshwardhanPatil07 HarshwardhanPatil07 changed the title e2e: Fix parallel membership checks and serialized rollout waits parallel membership checks and serialized rollout waits failures Oct 12, 2026
@alicefr
alicefr merged commit 4eb49dd into bootc-dev:main Oct 12, 2026
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants