docs: canary testing guide + fork-PR preview workflow#1369
Conversation
Extracted from #1353 to keep that PR scoped to the Codex adapter migration. Content authored on #1353 by @vixenclawsastraagent: - docs/canary-tests.md: complete canary workflow — preview builds, safety requirements, acceptance criteria, evidence template, cleanup, and rollback drills. This guide's process was exercised end-to-end during #1353's two canary rounds. - CONTRIBUTING.md: fix the E2E section's dispatch instructions — fork contributors cannot dispatch PR Preview Build with --ref <branch> (403); a maintainer dispatches from main and the workflow resolves the PR head automatically. - README architecture diagrams: updated to show gateway adapters (standalone or embedded unified), WeCom/MS Teams, and the local vs AgentCore runtime boundary. Co-authored-by: vixenclawsastraagent <268079781+vixenclawsastraagent@users.noreply.github.com>
This comment has been minimized.
This comment has been minimized.
Keep this PR scoped to the canary-testing process docs (guide + CONTRIBUTING E2E fix). The README architecture diagram rewrite is an independent change.
|
Note LGTM ✅ — Comprehensive canary-testing guide with correct fork-PR dispatch fix; all cross-references verified against current main. What This PR DoesExtracts standalone documentation from #1353 so that PR stays a pure Codex adapter migration. Adds a comprehensive canary-testing guide and corrects the fork-contributor dispatch instructions in CONTRIBUTING.md. How It WorksPure documentation PR — no code changes:
Findings
Finding Details🟢 F1: Well-organized layered testing guideThe five-layer approach (image inspection → ACP smoke → isolation → interactive → gateway E2E) is systematic and progressively validates from static to dynamic. Each layer has explicit pass criteria that can be verified independently. 🟢 F2: Security-first canary designThe guide explicitly forbids dual-instance bot tokens, prohibits pasting credentials in logs/PRs, isolates volumes, and uses mode-600 env files. Good operational discipline baked into the process. 🟢 F3: Workflow cross-reference verifiedThe 🟢 F4: Worked example link validComment 🟢 F5: Correct fork-PR dispatch fixThe old Baseline Check
What's Good (🟢)
5️⃣ Three Reasons We Might Not Need This PR
Counter: The guide documents a real process exercised end-to-end, in-tree docs are discoverable without wiki access, and the title discrepancy is cosmetic — the PR body accurately describes the current scope. |
|
Note LGTM ✅ — Accurate, battle-tested process documentation; commands and image-tag formats verified against the workflow that was actually exercised on #1353. What This PR DoesDocuments the canary-testing workflow for PRs (5-layer validation from image inspection to Discord gateway E2E) and fixes CONTRIBUTING's E2E dispatch instructions, which previously told fork contributors to use Findings
Verified
Extracted from #1353 per maintainer scope review; original authorship credited via Co-authored-by. |
What problem does this solve?
Extracted from #1353 per maintainer scope review, so that PR stays a pure Codex adapter migration. This PR carries the standalone documentation work authored there by @vixenclawsastraagent (credited via Co-authored-by):
PR Preview Buildwith--ref <branch>(HTTP 403); a maintainer dispatches frommainand the workflow resolves the PR head automatically.Validation
docs/canary-tests.mdcross-references verified against the pr-preview.yml workflow inputs and the feat(codex)!: migrate ACP adapter #1353 canary evidence.Cargo.tomlunified feature list anddocs/adr/unified-binary.md.Refs #1353.