From 101cfb2a14005f15eed72399c993856bfb3d7896 Mon Sep 17 00:00:00 2001 From: Kyle Sexton <153232337+kyle-sexton@users.noreply.github.com> Date: Sat, 31 Oct 2026 12:11:53 -0400 Subject: [PATCH 1/4] fix(ai-slop): name commit messages, PR bodies and interface copy in the audit description Ship the description line held back by the #11169 split, now that a trigger measurement backs it: no lost trigger on the frozen probe set and a gain on a held-out set written blind, at the 5-point margin. Closes #11540 Co-Authored-By: Claude Opus 5.5 --- .changes/ai-slop/fix-11540-audit-description-8e3b51c4.md | 7 +++++++ plugins/ai-slop/skills/audit/SKILL.md | 2 +- 2 files changed, 8 insertions(+), 1 deletion(-) create mode 100644 .changes/ai-slop/fix-11540-audit-description-8e3b51c4.md diff --git a/.changes/ai-slop/fix-11540-audit-description-8e3b51c4.md b/.changes/ai-slop/fix-11540-audit-description-8e3b51c4.md new file mode 100644 index 00000000000..b4d162aa24c --- /dev/null +++ b/.changes/ai-slop/fix-11540-audit-description-8e3b51c4.md @@ -0,0 +1,7 @@ +--- +bump: patch +--- + +### Changed + +- The `/ai-slop:audit` description names commit messages, PR bodies and interface copy beside markdown, so requests about those texts reach the skill. A trigger measurement on Opus 5.5 found no lost trigger on the frozen probe set (90.0% before and after) and a gain on a held-out set (72.2% to 98.1%), mostly from commit, PR and copy requests. diff --git a/plugins/ai-slop/skills/audit/SKILL.md b/plugins/ai-slop/skills/audit/SKILL.md index 7e18761ffc4..da074e13f64 100644 --- a/plugins/ai-slop/skills/audit/SKILL.md +++ b/plugins/ai-slop/skills/audit/SKILL.md @@ -1,5 +1,5 @@ --- -description: "Audit markdown prose for AI-writing tells (slop): em dashes (zero-tolerance by default), emoji formatting, AI vocabulary, negative parallelisms, chatbot phrases, filler, stacked hedging, citation artifacts, model-era phrases ('that's the unlock', 'the part most people skip'), and the rest of the catalog (distilled from Wikipedia's Signs of AI writing plus an evolving model-era inventory), plus a judgment rubric for superficial analysis, vague attribution, promotional tone, metaphor jargon ('load-bearing', 'seam'), figures standing in for facts, over-compressed text, and mechanism-free claims. Use when: 'check for AI slop', 'de-slop this doc', 'unslop this', 'find AI tells', 'does this read AI-written', 'remove em dashes', or before publishing agent-written prose. Read-only by default; 'fix' as an explicit argument applies rewrites behind a semantic-diff guard and may be chained ('detect and rewrite'). Empty target audits the repo's tracked markdown, high-impact and high-velocity files first." +description: "Audit markdown, commit messages, PR bodies and interface copy for AI-writing tells (slop) from Wikipedia's Signs of AI writing plus model-era tells: em dashes, emoji, AI vocabulary, negative parallelisms, chatbot phrases, filler, stacked hedges, citation artifacts, model-era phrases ('that's the unlock', 'the part most people skip'), plus a judgment rubric for superficial analysis, vague attribution, promotional tone, metaphor jargon ('load-bearing', 'seam'), figures for facts, over-compression, mechanism-free claims and generic headlines. Use when: 'check for AI slop', 'de-slop this doc', 'unslop this', 'find AI tells', 'does this read AI-written', 'remove em dashes', 'check this commit message', 'unslop this PR body', 'is this headline generic', or before publishing agent-written prose. Read-only by default; an explicit 'fix' rewrites behind a semantic-diff guard, chainable ('detect and rewrite'). Empty target audits the repo's tracked markdown, high-impact and high-velocity files first." argument-hint: "[audit|fix] [target|user-scope [memory]|commit [rev]|pr-body|copy ]" user-invocable: true disable-model-invocation: false From c9eb458f753527925d7d5f01ff114c9298bd8562 Mon Sep 17 00:00:00 2001 From: Kyle Sexton <153232337+kyle-sexton@users.noreply.github.com> Date: Sat, 31 Oct 2026 23:39:54 -0400 Subject: [PATCH 2/4] fix(ai-slop): keep code-comment requests with audit-comment-residue in the audit description The broadened scope drew a code-comments probe (neg-train-04) from 6/6 held to 3/6. Name the sibling skill, which the probes show confused, and trim to the 1024 cap. Co-Authored-By: Claude Opus 5.5 --- plugins/ai-slop/skills/audit/SKILL.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/plugins/ai-slop/skills/audit/SKILL.md b/plugins/ai-slop/skills/audit/SKILL.md index da074e13f64..4d901348990 100644 --- a/plugins/ai-slop/skills/audit/SKILL.md +++ b/plugins/ai-slop/skills/audit/SKILL.md @@ -1,5 +1,5 @@ --- -description: "Audit markdown, commit messages, PR bodies and interface copy for AI-writing tells (slop) from Wikipedia's Signs of AI writing plus model-era tells: em dashes, emoji, AI vocabulary, negative parallelisms, chatbot phrases, filler, stacked hedges, citation artifacts, model-era phrases ('that's the unlock', 'the part most people skip'), plus a judgment rubric for superficial analysis, vague attribution, promotional tone, metaphor jargon ('load-bearing', 'seam'), figures for facts, over-compression, mechanism-free claims and generic headlines. Use when: 'check for AI slop', 'de-slop this doc', 'unslop this', 'find AI tells', 'does this read AI-written', 'remove em dashes', 'check this commit message', 'unslop this PR body', 'is this headline generic', or before publishing agent-written prose. Read-only by default; an explicit 'fix' rewrites behind a semantic-diff guard, chainable ('detect and rewrite'). Empty target audits the repo's tracked markdown, high-impact and high-velocity files first." +description: "Audit markdown, commit messages, PR bodies and interface copy for AI-writing tells (slop) from Wikipedia's Signs of AI writing plus model-era tells: em dashes, emoji, AI vocabulary, negative parallelisms, chatbot phrases, filler, stacked hedges, citation artifacts, model-era phrases ('that's the unlock', 'the part most people skip'), plus a judgment rubric for superficial analysis, vague attribution, promotional tone, metaphor jargon ('load-bearing', 'seam'), figures for facts, over-compression, mechanism-free claims and generic headlines. Use when: 'check for AI slop', 'de-slop this doc', 'unslop this', 'find AI tells', 'does this read AI-written', 'remove em dashes', 'check this commit message', 'unslop this PR body', 'is this headline generic', or before publishing agent-written prose. Read-only by default; explicit 'fix' rewrites behind a semantic-diff guard ('detect and rewrite'). Empty target audits tracked markdown, busiest files first. Not for code comments (/code-tidying:audit-comment-residue)." argument-hint: "[audit|fix] [target|user-scope [memory]|commit [rev]|pr-body|copy ]" user-invocable: true disable-model-invocation: false From 2408eded821228b51c07da332e318584f96f9900 Mon Sep 17 00:00:00 2001 From: Kyle Sexton <153232337+kyle-sexton@users.noreply.github.com> Date: Sun, 1 Nov 2026 00:04:56 -0400 Subject: [PATCH 3/4] docs(ai-slop): state the measured result in the audit description fragment Co-Authored-By: Claude Opus 5.5 --- .changes/ai-slop/fix-11540-audit-description-8e3b51c4.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.changes/ai-slop/fix-11540-audit-description-8e3b51c4.md b/.changes/ai-slop/fix-11540-audit-description-8e3b51c4.md index b4d162aa24c..f416fe8135d 100644 --- a/.changes/ai-slop/fix-11540-audit-description-8e3b51c4.md +++ b/.changes/ai-slop/fix-11540-audit-description-8e3b51c4.md @@ -4,4 +4,4 @@ bump: patch ### Changed -- The `/ai-slop:audit` description names commit messages, PR bodies and interface copy beside markdown, so requests about those texts reach the skill. A trigger measurement on Opus 5.5 found no lost trigger on the frozen probe set (90.0% before and after) and a gain on a held-out set (72.2% to 98.1%), mostly from commit, PR and copy requests. +- The `/ai-slop:audit` description names commit messages, PR bodies, interface copy and generic headlines beside markdown, and sends code-comment requests to `/code-tidying:audit-comment-residue`. Measured before and after on the frozen probes and a blind held-out set (Opus 5.5, every run VALID): no lost trigger, and held-out triggering rose from 58% to 83%. From 6712cc5821034446e87cccab9d4f75cc535cbe84 Mon Sep 17 00:00:00 2001 From: Kyle Sexton <153232337+kyle-sexton@users.noreply.github.com> Date: Sun, 1 Nov 2026 00:33:20 -0400 Subject: [PATCH 4/4] docs(ai-slop): state the Sonnet trigger measurement in the changelog fragment Refs: #11540 Co-Authored-By: Claude Opus 5.5 --- .changes/ai-slop/fix-11540-audit-description-8e3b51c4.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.changes/ai-slop/fix-11540-audit-description-8e3b51c4.md b/.changes/ai-slop/fix-11540-audit-description-8e3b51c4.md index f416fe8135d..ac9e92c5a2b 100644 --- a/.changes/ai-slop/fix-11540-audit-description-8e3b51c4.md +++ b/.changes/ai-slop/fix-11540-audit-description-8e3b51c4.md @@ -4,4 +4,4 @@ bump: patch ### Changed -- The `/ai-slop:audit` description names commit messages, PR bodies, interface copy and generic headlines beside markdown, and sends code-comment requests to `/code-tidying:audit-comment-residue`. Measured before and after on the frozen probes and a blind held-out set (Opus 5.5, every run VALID): no lost trigger, and held-out triggering rose from 58% to 83%. +- The `/ai-slop:audit` description names commit messages, PR bodies, interface copy and generic headlines beside markdown, and sends code-comment requests to `/code-tidying:audit-comment-residue`. Measured before and after on the frozen probes and a blind held-out set on Opus 5.5 and Sonnet 5.5, every run VALID: no lost trigger, and held-out triggering rose from 58% to 83% on Opus and from 57% to 70% on Sonnet.