You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Flake audit: shared-fixture + async-import-shim tests masked by CI retry:1 #2813
PR #2812 fixed one non-hermetic unit test (backfill-images-slug-filter.test.ts) that intermittently failed in CI (expected [] to deeply equal ['beta']) under the Vitest-4 forks pool — passing locally, failing only in the full 4-worker run afterretry:1 already fired.
The deeper problem it exposed: retry:1 in CI silently masks flaky tests. A test that needs a retry to go green looks healthy until the retry also loses, at which point it reads as 'tests randomly break' and trains the team to ignore red.
Scope (over the coming days — not urgent)
Grep the suite for the same flake shape:
per-file beforeAll/afterAll fixtures shared across its (vs per-test beforeEach)
modules reached through the workspace-first async-import shim (try { await import('@tutorials/...') } catch { await import(bundle) } — ~116 files use it) imported by unit tests
Surface which tests currently depend on retry:1 to pass — a one-off CI run with retry:0 (or instrumentation) lists every retried-pass; that set is the invisible flake debt.
Activity
Merge pull request #2816 from sap-tutorials/worktree-flake-audit-2813