Concise skills rollout: repo-fleet-hygiene (4 skills, 1 model-invoked) #6613

Activity

1. kyle-sexton

   added a parent issue on Oct 7, 2026

   • Concise skills: one skill-creation standard, evals, and a fleet-wide rollout #6476
2. github-actions

   added

   needs-triageNot yet classified. Floor until a type and one priority tier are set.Not yet classified. Floor until a type and one priority tier are set.

   on Oct 7, 2026
3. github-actions commented on Oct 7, 2026

   

   github-actionsBot

   on Oct 7, 2026 – with GitHub Actions

   Last edited by melodic-automation-lanes

   Contributor

   More actions

   Proposed work class: work-class: scoped
   Basis: automated intake triage; the lanes App applied this class.

   Size: Medium
   Complexity: Medium
   Uncertainty: Known
   Flags: none
   Blocked by: none

   Understood: rewrite the four repo-fleet-hygiene skills (audit, apply, setup, sync) to the skill criteria in one draft PR, following the per-plugin runbook. The done-when list is explicit: no new quality-check FAILs, a passing eval suite, a probe file for audit, a per-skill decision table and an unmeasured-items list in the PR body, and a version or changelog entry. Eval spend is stated as pre-approved from prepaid credit. Nothing is missing, and I found no duplicates among the open issues. This is part of #6476.

   _{Automated triage, applied by the lanes App.}
4. github-actions

   added

   needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.Human-in-the-loop required; autonomous sessions must not resolve items carrying this.

   on Oct 7, 2026
5. kyle-sexton

   added the

   Task

   issue type on Oct 12, 2026
6. kyle-sexton

   removed

   needs-triageNot yet classified. Floor until a type and one priority tier are set.Not yet classified. Floor until a type and one priority tier are set.

   on Oct 12, 2026
7. kyle-sexton

   removed

   needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.Human-in-the-loop required; autonomous sessions must not resolve items carrying this.

   on Oct 24, 2026
8. kyle-sexton commented on Oct 24, 2026

   

   kyle-sexton

   on Oct 24, 2026

   MemberAuthor

   More actions

   Released by the owner's HITL session (2026-10-24, C12): it waited only on a removed gate. Intake triage re-runs on it to set its fields, then admission takes it.
9. github-actions commented on Oct 25, 2026

   

   github-actionsBot

   on Oct 25, 2026 – with GitHub Actions

   Contributor

   More actions

   The triage sweep dispatched intake triage for this issue (attempt 1 of 2).
10. github-actions

    added

    priority: mediumReal value, no hard deadline; normal backlog flow.Real value, no hard deadline; normal backlog flow.

    on Oct 25, 2026
11. melodic-automation-lanes

    added

    status: readyTriaged, unblocked, and fully specified; eligible to pick up.Triaged, unblocked, and fully specified; eligible to pick up.

    work-class: scopedA briefed fix or small feature; blast radius bounded by the brief, tests exist.A briefed fix or small feature; blast radius bounded by the brief, tests exist.

    admission-deferred

    agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.Fully specified and briefed; eligible for autonomous pickup from the frontier.

    needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.Human-in-the-loop required; autonomous sessions must not resolve items carrying this.

    and removed

    admission-deferred

    agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.Fully specified and briefed; eligible for autonomous pickup from the frontier.

    on Oct 25, 2026
12. melodic-automation-lanes commented on Oct 25, 2026

    

    melodic-automation-lanesBot

    on Oct 25, 2026

    Contributor

    More actions

    The work-resolve-issue lane stopped partway through this issue and needs a person.

    Why, in the run's own words:

    This lane cannot do what the issue's done-when needs. The rewrite protocol in plugins/playbooks/skills/skill-authoring/reference/skill-criteria.md (Measurement, steps 4 and 6) ships only parts that were measured, and the issue asks for a per-skill decision table with before and after numbers. Those numbers come from paid claude plugin eval / /evals:plugin-eval passes, /skill-quality:check (before state and measure-invocation), /evals:design, /evals:validate and /docs-hygiene:compress compare. Only the work-items plugin is loaded here, and Bash may run only the named check and verify wrappers, so none of these can run. Rewriting the four skills without measuring them would ship cuts the protocol forbids. The issue also wants the rollout in one PR, so a PR with only the probe file or unvalidated cases would split it. Nothing was changed. This needs a session that can run the eval and skill-quality tooling under the --max-cost-usd 5 per-pass ceiling.

    What the run says it did not do:

    • Inventory and before state via /skill-quality:check plugins/repo-fleet-hygiene: the skill is not loaded in this lane
    • Outcome cases via /evals:design, /evals:validate, grader calibration and the smoke pass: not available in this lane, and eval passes are paid runs this lane cannot launch
    • Probe file plugins/repo-fleet-hygiene/probes/audit.json plus the held-out set, checked with /skill-quality:check measure-invocation: the checker is not available here, and a probe-only PR would split the one-PR rollout
    • Rewrite of audit, apply, setup and sync, the before/after measurement, the /docs-hygiene:compress compare meaning diff, and the per-skill decision table: the protocol ships only measured parts
    • Changelog fragment for repo-fleet-hygiene: no plugin change was made, so none is owed

    Run: https://github.com/melodic-software/claude-code-plugins/actions/runs/40195215913

    To retry, remove needs-human and add agent-ready again.
13. kyle-sexton

    marked this as blocked on Oct 27, 2026

    • feat(ci): validate, gate and summarize dispatched plugin eval runs #9704
14. kyle-sexton commented on Oct 27, 2026

    

    kyle-sexton

    on Oct 27, 2026

    MemberAuthor

    More actions

    This was generated by AI.

    Parked for capacity, not for the owner. This rollout's remaining work is the measured eval passes of the batch-1 protocol, which the issue lane cannot run: it cannot start claude or claude plugin eval (see the lane's escalation on #6585, https://github.com/melodic-software/claude-code-plugins/actions/runs/40186335064). It waits on the plugin eval dispatch work in #9704, now a blocked-by edge, so admission holds it until #9704 closes.

    Under the owner's 2026-10-26 stop rule, a person is needed only for a change in intent or vision, an implementation finding that changes the intent or primary design, or a high or critical security issue; host, attended and eval runs are agent work. So needs-human comes off, and the issue moves to host-run with status: confirmed, which keeps the issue lane from taking it when #9704 closes: #9704 adds an eval dispatch workflow, not eval capability for the issue lane.
15. kyle-sexton

    added

    host-runNeeds an unattended run on a host; the host runner takes it, not a person or the issue lane.Needs an unattended run on a host; the host runner takes it, not a person or the issue lane.

    status: confirmedA maintainer confirmed the item is real and in scope; ready to be worked.A maintainer confirmed the item is real and in scope; ready to be worked.

    and removed

    status: readyTriaged, unblocked, and fully specified; eligible to pick up.Triaged, unblocked, and fully specified; eligible to pick up.

    needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.Human-in-the-loop required; autonomous sessions must not resolve items carrying this.

    on Oct 27, 2026
16. kyle-sexton

    self-assigned this

    on Nov 1, 2026
17. kyle-sexton commented on Nov 1, 2026

    

    kyle-sexton

    on Nov 1, 2026

    Last edited by kyle-sexton

    MemberAuthor

    More actions

    No description provided.
18. kyle-sexton commented on Nov 1, 2026

    

    kyle-sexton

    on Nov 1, 2026

    MemberAuthor

    More actions

    Progress: the outcome eval cases and frozen audit trigger probes for repo-fleet-hygiene merged in #12051 (squash 636da98). That PR changes no skill text. This issue stays open for its measured pass: a rewrite of the skill, then a with/without eval run on the frozen suite.