user-experience: install-test and confirm the unconfirmed and deferred route rows #6667

Activity

1. github-actions

   added

   needs-triageNot yet classified. Floor until a type and one priority tier are set.Not yet classified. Floor until a type and one priority tier are set.

   on Oct 9, 2026
2. github-actions commented on Oct 9, 2026

   

   github-actionsBot

   on Oct 9, 2026 – with GitHub Actions

   Last edited by melodic-automation-lanes

   Contributor

   More actions

   Proposed work class: work-class: scoped
   Basis: automated intake triage; the lanes App applied this class.

   Size: Small
   Complexity: Low
   Uncertainty: Knowable
   Flags: none
   Blocked by: none

   Decision recorded. The owner approved applying independently verified recommendations (confirmed, low-risk set) on 2026-10-13.

   • Authorize an agent to install the plugins behind the 5 account-free skill rows (/design:, /product-management:) in a throwaway config directory and confirm them? → Yes, sandboxed config dir, no user-scope change
     Basis: AGENTS.md 'When to stop' (user-scope config needs the user); docs/conventions/routing-as-data/README.md:40-41
   • What happens to the 12 login or paid rows (usertesting, dovetail, miro x3, figma, optimal, maze, contentsquare, amplitude, posthog, mixpanel)? → Keep them deferred and narrow the acceptance criteria to the account-free rows
     Basis: docs/conventions/routing-as-data/README.md:40-41 ('A deferred route is never used'); plugins/user-experience/reference/routing.json (12 deferred rows as of 2026-10-09)

   [quote truncated; the full decision is at the link]

   #6667 (comment)

   The decision settles the open questions. The work is to install-test the 5 account-free skill rows in a sandboxed config directory and confirm them. The 12 account-bound rows stay deferred.

   _{Automated triage, applied by the lanes App.}
3. github-actions

   added

   help wantedMaintainer would welcome help.Maintainer would welcome help.

   priority: mediumReal value, no hard deadline; normal backlog flow.Real value, no hard deadline; normal backlog flow.

   on Oct 9, 2026
4. kyle-sexton

   added the

   Task

   issue type on Oct 12, 2026
5. kyle-sexton

   removed

   needs-triageNot yet classified. Floor until a type and one priority tier are set.Not yet classified. Floor until a type and one priority tier are set.

   on Oct 12, 2026
6. kyle-sexton commented on Oct 13, 2026

   

   kyle-sexton

   on Oct 13, 2026

   MemberAuthor

   More actions

   Decision recorded. The owner approved applying independently verified recommendations (confirmed, low-risk set) on 2026-10-13.

   • Authorize an agent to install the plugins behind the 5 account-free skill rows (/design:, /product-management:) in a throwaway config directory and confirm them? → Yes, sandboxed config dir, no user-scope change
     Basis: AGENTS.md 'When to stop' (user-scope config needs the user); docs/conventions/routing-as-data/README.md:40-41
   • What happens to the 12 login or paid rows (usertesting, dovetail, miro x3, figma, optimal, maze, contentsquare, amplitude, posthog, mixpanel)? → Keep them deferred and narrow the acceptance criteria to the account-free rows
     Basis: docs/conventions/routing-as-data/README.md:40-41 ('A deferred route is never used'); plugins/user-experience/reference/routing.json (12 deferred rows as of 2026-10-09)

   routing.json ships 5 unconfirmed account-free skill rows and 12 deferred account-bound rows that need install-testing before they can be confirmed. Account-bound rows need the owner's logins (one is paid), and the acceptance criteria currently demand every row be confirmed or removed.

   Verified by an independent fresh-context check (confirmed, risk low): gh issue view 6667 (OPEN); origin/main docs/conventions/routing-as-data/README.md:40-41 status rules; origin/main plugins/user-experience/reference/routing.json: 5 unconfirmed account-free, 12 deferred (miro x3), 2 confirmed; anthropics/knowledge-work-plugins: PUBLIC, marketplace lists design and product-management; all 5 SKILL.md paths exist (assumption true)

   Admission to an agent lane stays with the work-class rules and owner ratification.
7. github-actions commented on Oct 25, 2026

   

   github-actionsBot

   on Oct 25, 2026 – with GitHub Actions

   Last edited by github-actions

   Contributor

   More actions

   The triage sweep dispatched intake triage for this issue (attempt 2 of 2).
8. melodic-automation-lanes

   added

   status: readyTriaged, unblocked, and fully specified; eligible to pick up.Triaged, unblocked, and fully specified; eligible to pick up.

   work-class: scopedA briefed fix or small feature; blast radius bounded by the brief, tests exist.A briefed fix or small feature; blast radius bounded by the brief, tests exist.

   status: needs-decisionAwaiting a human or maintainer judgment call.Awaiting a human or maintainer judgment call.

   and removed

   status: readyTriaged, unblocked, and fully specified; eligible to pick up.Triaged, unblocked, and fully specified; eligible to pick up.

   on Oct 25, 2026
9. melodic-automation-lanes commented on Oct 25, 2026

   

   melodic-automation-lanesBot

   on Oct 25, 2026

   Contributor

   More actions

   Not admitted to the issue lane: no trusted-human acceptance criteria: a listed human must put the confirmed - [ ] criteria in the body or post them as their own comment, or, on an issue a listed human filed, intake's newest refinement comment must hold them unedited. Admission takes the issue once each of those is met, when intake triages it again (.github/actions/resolve-config/admission-rules.json).
10. melodic-automation-lanes commented on Oct 25, 2026

    

    melodic-automation-lanesBot

    on Oct 25, 2026

    Last edited by melodic-automation-lanes

    Contributor

    More actions

    The latest triage verdict holds nothing: the issue is at status: ready.
11. melodic-automation-lanes commented on Oct 25, 2026

    

    melodic-automation-lanesBot

    on Oct 25, 2026

    Contributor

    More actions

    Refinement. A read-only run explored this repository, searched its issues and pull requests, and read the allowed docs to draft what follows. On an issue a listed human filed, it counts as the issue's spec once posted, while unedited; it is still model text, so check it.

    Intended outcome: Install-test the design and product-management plugins in a throwaway config directory and set the 5 account-free unconfirmed skill rows in routing.json to confirmed with a fresh as_of, leaving the 12 login or paid rows deferred.

    Acceptance criteria

    • In plugins/user-experience/reference/routing.json the rows /design:user-research, /product-management:synthesize-research, /design:research-synthesis, /design:design-critique and /product-management:metrics-review each have status confirmed, or are removed with a reason stated in the PR.
    • Each confirmed row has as_of set to the test date, not 2026-10-09.
    • The install ran with a throwaway CLAUDE_CONFIG_DIR, and no user-scope config was changed.
    • After install, scripts/detect.mjs reports design@​knowledge-work-plugins and product-management@​knowledge-work-plugins under installed in that config directory.
    • Each of the 5 skills ran from /user-experience:shape or its job skill and returned output the skill can label; the PR notes this per row.
    • Each confirmed row's detect, pointer and recheck were checked against the installed plugin and the marketplace as of the test date, and corrected if wrong.
    • The 12 rows with account login or paid (usertesting, dovetail, miro x3, figma, optimal, maze, contentsquare, amplitude, posthog, mixpanel) are unchanged and still deferred.
    • node --test 'plugins/user-experience/tests/*.test.mjs' passes.
    • The PR description notes the test date and the install steps used, and says the issue stays open for the 12 deferred rows.

    Dependencies

    • Refs #​6306 (parent tracking); no blocking work found.
    • The 12 deferred rows wait on the owner's logins and a paid account, and are out of scope here per the recorded decision.

    Related work

    • feat(user-experience): add the user-experience plugin #6669 (related): Merged-closed PR that added the user-experience plugin and its routing.json rows.

    Sources read

    • /home/runner/work/_temp/refine-data/context.json: kyle-sexton's Decision recorded comment authorizes sandboxed install for the 5 account-free rows and keeps the 12 account-bound rows deferred, narrowing the acceptance criteria.
    • plugins/user-experience/reference/routing.json:5,8,9,17,24: the five account-free skill rows are unconfirmed with as_of 2026-10-09.
    • plugins/user-experience/reference/routing.json:6,10,11,13-15,18,22,25,27-29: the twelve account-bound rows are deferred.
    • docs/conventions/routing-as-data/README.md:40-41: a deferred route is never used; an unconfirmed route is disclosed; an account-bound row is never unconfirmed.

    _{Automated refinement by the lanes App. Admission counts only criteria a listed human wrote: to confirm these, post them as your own comment whose first line is **Decision recorded.**, which sends the issue back through intake.}
12. 2 remaining items

    Load more
13. melodic-automation-lanes

    added

    status: readyTriaged, unblocked, and fully specified; eligible to pick up.Triaged, unblocked, and fully specified; eligible to pick up.

    admission-deferred

    agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.Fully specified and briefed; eligible for autonomous pickup from the frontier.

    needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.Human-in-the-loop required; autonomous sessions must not resolve items carrying this.

    and removed

    admission-deferred

    agent-readyFully specified and briefed; eligible for autonomous pickup from the frontier.Fully specified and briefed; eligible for autonomous pickup from the frontier.

    on Oct 26, 2026
14. melodic-automation-lanes commented on Oct 26, 2026

    

    melodic-automation-lanesBot

    on Oct 26, 2026

    Contributor

    More actions

    The work-resolve-issue lane stopped partway through this issue and needs a person.

    Why, in the run's own words:

    This lane cannot install-test anything, so it changed nothing. The issue as narrowed by the 2026-10-13 decision needs three things: install the design and product-management plugins from knowledge-work-plugins into a throwaway CLAUDE_CONFIG_DIR, run plugins/user-experience/scripts/detect.mjs to show both under installed, and run each of the 5 skills from /user-experience:shape or its job skill. The lane's Bash runs only its named wrapper scripts. It cannot run the claude CLI, node, or a Claude session with those plugins loaded. Setting the 5 rows to confirmed without that test would go against docs/conventions/routing-as-data/README.md:40-41 and the routing.json note, which define unconfirmed as 'has not been install-tested'. The test needs a run with the claude CLI and node available in a sandboxed config directory, either a person or a lane that allows it.

    What the run says it did not do:

    • Install designknowledge-work-plugins and product-managementknowledge-work-plugins into a throwaway CLAUDE_CONFIG_DIR. Not possible: this lane's Bash cannot run the claude CLI.
    • Run plugins/user-experience/scripts/detect.mjs against that config directory and confirm both plugins appear under installed. Not possible: this lane cannot run node.
    • Run each of the 5 skills from /user-experience:shape or its job skill and check the output can be labeled. Not possible: this needs a Claude session with the plugins loaded.
    • Set the 5 rows to confirmed with a fresh as_of and re-check their detect, pointer and recheck. Not done, because the install test above never ran.
    • node --test 'plugins/user-experience/tests/*.test.mjs'. Not run: this lane cannot run node, and nothing changed.
    • PR prep review, verify and checks steps. Skipped: there is no diff to review, build or lint.

    Run: https://github.com/melodic-software/claude-code-plugins/actions/runs/40261911416

    To retry, remove needs-human and add agent-ready again.
15. kyle-sexton commented on Oct 26, 2026

    

    kyle-sexton

    on Oct 26, 2026

    MemberAuthor

    More actions

    This was generated by AI.

    Routed to the host runner, not the owner. The remaining work is an install test in a throwaway CLAUDE_CONFIG_DIR with the claude CLI and node, which the issue lane cannot run (https://github.com/melodic-software/claude-code-plugins/actions/runs/40261911416).

    Under the owner's 2026-10-26 stop rule, a person is needed only for a change in intent or vision, an implementation finding that changes the intent or primary design, or a high or critical security issue; host, attended and eval runs are agent work. So needs-human comes off. It moves to the host-run label, and the host runner takes it.
16. kyle-sexton

    added

    host-runNeeds an unattended run on a host; the host runner takes it, not a person or the issue lane.Needs an unattended run on a host; the host runner takes it, not a person or the issue lane.

    status: confirmedA maintainer confirmed the item is real and in scope; ready to be worked.A maintainer confirmed the item is real and in scope; ready to be worked.

    and removed

    status: readyTriaged, unblocked, and fully specified; eligible to pick up.Triaged, unblocked, and fully specified; eligible to pick up.

    needs-humanHuman-in-the-loop required; autonomous sessions must not resolve items carrying this.Human-in-the-loop required; autonomous sessions must not resolve items carrying this.

    on Oct 27, 2026
17. kyle-sexton commented on Oct 28, 2026

    

    kyle-sexton

    on Oct 28, 2026

    MemberAuthor

    More actions

    Host run. Install-tested the five account-free user-experience routes in a throwaway CLAUDE_CONFIG_DIR and ran each one from its job skill.

    What ran (2026-10-27, Claude Code 2.1.312):

    • In a throwaway config dir: claude plugin marketplace add anthropics/knowledge-work-plugins (commit 2574e29), then claude plugin install design@knowledge-work-plugins and product-management@knowledge-work-plugins (both 1.2.0), plus user-experience@melodic-software 0.2.7 from the branch. No user-scope config changed. The main login was checked before and after.
    • node scripts/detect.mjs against that install: all five ids under installed, each reachable: true, reason null.
    • One claude -p --permission-mode auto session per route, with the plugins loaded via --plugin-dir. A session-only PATH shim sent the skill's claude plugin list call to the throwaway config. Each session invoked exactly the expected routed skill, named the route and labeled its output:
      • /design:user-research from /user-experience:plan-user-research
      • /product-management:synthesize-research from /user-experience:synthesize (rank 1)
      • /design:research-synthesis from /user-experience:synthesize, with product-management not loaded (rank 2)
      • /design:design-critique from /user-experience:evaluate
      • /product-management:metrics-review from /user-experience:evaluate
    • node --test plugins/user-experience/tests/*.test.mjs: 123 pass, 0 fail.

    Acceptance criteria:

    • Five rows confirmed: pass.
    • as_of set to 2026-10-27: pass.
    • Throwaway config, no user-scope change: pass.
    • detect lists both plugins under installed: pass.
    • Each skill ran from its job skill and gave labelable output: pass.
    • detect, pointer and recheck checked: pass. All were correct, so none changed.
    • The twelve account-bound rows unchanged and deferred: pass.
    • Tests pass: pass.
    • PR notes the test date and install steps: pass.

    PR: #10608 (draft; closes this issue when merged).

    Target labels: add none; remove host-run.
18. kyle-sexton

    removed

    host-runNeeds an unattended run on a host; the host runner takes it, not a person or the issue lane.Needs an unattended run on a host; the host runner takes it, not a person or the issue lane.

    on Oct 28, 2026
19. kyle-sexton

    closed this as completedin #10608on Oct 28, 2026