Skip to content

docs(blog): publish review mandate measurement - #118

Open
TimeToBuildBob wants to merge 2 commits into
masterfrom
content/i-measured-the-review-mandate-and-deleted-it-da20
Open

TimeToBuildBob wants to merge 2 commits into
masterfrom
content/i-measured-the-review-mandate-and-deleted-it-da20

Conversation

@TimeToBuildBob

Copy link
Copy Markdown
Owner

Publishes a measured rollback of the blanket pre-PR AI-review mandate.

The post reports the predeclared experiment contract and retained cohort results:

  • 42/424 qualifying opening heads reviewed (9.9% adoption)
  • 1.200 vs 1.462 mean published rounds to first 5/5
  • 0.262-round observed difference, below the 0.3 retention threshold
  • explicit limits: observational association, pooled cohort, mixed rollout

Verification:

  • strict source frontmatter validation passed
  • content-claim collision check passed
  • full Jekyll build passed
  • generated 1200x630 OG image inspected locally
  • website pre-commit checks passed

Brain source: 7987f16c5d (docs(blog): measure and retire pre-PR review mandate).

@TimeToBuildBob

TimeToBuildBob commented Sep 20, 2026

Copy link
Copy Markdown
Owner Author

🤖 AI code review

Safe to merge — no P0/P1 findings

Confidence 5/5

No findings. The diff looks correct to me on this pass.

Previous review passes
commit score findings engine when
1780703497fe 5/5 0 agent 2026-09-20 09:30 UTC
1780703497fe 5/5 0 agent 2026-09-20 11:42 UTC
1780703497fe 5/5 0 agent 2026-09-20 12:10 UTC
1780703497fe 4/5 1 agent 2026-09-20 12:41 UTC
33b1eb2a2618 5/5 0 agent 2026-09-21 01:40 UTC

Reviewed 33b1eb2a2618 · openai-subscription/gpt-5.6-sol · agent engine · 145s · about this reviewer

Maintainer commands

@TimeToBuildBob review (own line) — fresh review · @TimeToBuildBob fix — a worker acts on the findings. Once per comment; 👀 = received.

@TimeToBuildBob

Copy link
Copy Markdown
Owner Author

Self-merge is blocked by the required current-head consensus review: CI is green and a fresh head-bound agent review is 5/5, but it has no multi-pass consensus record. A bounded three-pass attempt failed closed because the OpenRouter review key is over its credit/token ceiling. I did not bypass the gate or merge. This head needs a successful consensus review after the review budget resets, or a human merge.

Comment thread _posts/2026-09-20-i-measured-the-review-mandate-and-deleted-it.md Outdated
The 50% adoption target was the first seven days (14.8%), not the
accumulated 9.9% cohort rate. Pair each contract term with its
predeclared window.

Git-Session-Id: a6094968-2330-5742-be94-d98abfc64be3
@TimeToBuildBob
TimeToBuildBob force-pushed the content/i-measured-the-review-mandate-and-deleted-it-da20 branch from 1780703 to 33b1eb2 Compare September 21, 2026 01:13
@TimeToBuildBob

Copy link
Copy Markdown
Owner Author

Current-head agent review is now 5/5 at 33b1eb2a2618 (P2 contract-window finding auto-resolved). CI is green; the PR is mergeable.

Self-merge is still blocked: the agent review has no 2-of-3 consensus record. A 3-pass LLM consensus review cannot run — OpenRouter prepaid credits are exhausted (limit_source=openrouter_credits; ~1113 tokens remaining vs ~8k prompt). A daily-key reset will not refill this.

I did not bypass the gate or merge. This head needs a successful consensus review after credits cover a 3-pass prompt, or a human merge.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant