Skip to content

Fix tool name references in issue-triage workflow prompt#10502

Merged
timotheeguerin merged 2 commits intomainfrom
copilot/debug-agentic-triage-failure
Apr 27, 2026
Merged

Fix tool name references in issue-triage workflow prompt#10502
timotheeguerin merged 2 commits intomainfrom
copilot/debug-agentic-triage-failure

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented Apr 27, 2026

The Agentic Triage workflow (run 24915251147) produced no safe outputs because the prompt referenced non-existent tool names.

The prompt instructed the agent to use get_issue and get_issue_comments, but the actual MCP GitHub tools are:

Prompt referenced Actual tool
get_issue issue_read (method: get)
get_issue_comments issue_read (method: get_comments)
  • Updated step 1 and step 2 in .github/workflows/issue-triage.md to reference issue_read with the correct method parameters

Copilot AI linked an issue Apr 27, 2026 that may be closed by this pull request
…CP tool names

The agentic triage workflow prompt referenced `get_issue` and
`get_issue_comments` tools, but the actual GitHub MCP tools use
`issue_read` with method parameters (`get` and `get_comments`).

This mismatch caused the agent to fail to produce safe outputs
(no labels, comments, or noop) when triaging issue #10496.

Agent-Logs-Url: https://github.com/microsoft/typespec/sessions/b07993be-49ed-4ac4-a954-66be4043ddeb

Co-authored-by: timotheeguerin <1031227+timotheeguerin@users.noreply.github.com>
Copilot AI changed the title [WIP] Debug agentic triage workflow failure Fix tool name references in issue-triage workflow prompt Apr 27, 2026
Copilot AI requested a review from timotheeguerin April 27, 2026 12:40
@timotheeguerin timotheeguerin marked this pull request as ready for review April 27, 2026 12:45
@timotheeguerin timotheeguerin merged commit b2fa417 into main Apr 27, 2026
26 of 28 checks passed
@timotheeguerin timotheeguerin deleted the copilot/debug-agentic-triage-failure branch April 27, 2026 12:59
timotheeguerin added a commit that referenced this pull request Apr 27, 2026
…ures (#10504)

Agentic Triage workflow ([run
24996553319](https://github.com/microsoft/typespec/actions/runs/24996553319))
produced no safe outputs despite the agent running for ~4 minutes. This
is the second failure after PR #10502 fixed tool name references — the
agent still silently failed to call any safe output tool.

Analysis of the generated prompt and MCP gateway logs revealed three
issues:

- **Missing `get_file_contents` tool reference**: The prompt said "read
the file `eng/common/config/labels.ts`" without specifying the MCP tool
name or parameters. Now explicitly references `get_file_contents` with
`owner`/`repo`.
- **Unconditional `web-fetch` reference**: The prompt unconditionally
instructed the agent to "Use `web-fetch` to verify the playground link",
but only `safeoutputs` and `github` MCP servers were registered —
`web-fetch` was not available. Changed to conditional: "If the
`web_fetch` tool is available, use it to verify..."
- **No fallback instruction**: Added an explicit `## Important` section
reinforcing the requirement to call at least one safe output tool
(`add_comment`, `add_labels`, or `noop`) before finishing, with guidance
to call `noop` on errors.

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: timotheeguerin <1031227+timotheeguerin@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[aw] Agentic Triage failed

2 participants