-
Notifications
You must be signed in to change notification settings - Fork 35
Open
2 / 42 of 4 issues completedOpen
2 / 42 of 4 issues completed
Copy link
Labels
Description
Overview
This tracking issue addresses the recurring parameter validation failures in safe output MCP tools, particularly the add_comment tool which has a 6.67% failure rate due to missing required parameters.
Source: Discussion #7934 - Safe Output Health Report (2025-12-27)
Problem Summary
The Safe Output Health Monitor identified systematic issues:
- 4 out of ~60
add_commentcalls fail with "missing or empty 'item_number'" errors - This issue has persisted across multiple audits without improvement
- Overall safe output success rate is 96.67%, down from ideal 100%
Root Cause
Agents (particularly Copilot) are not consistently providing required MCP tool parameters, indicating:
- Insufficient clarity in MCP tool schema documentation
- Generic error messages that don't guide agents to self-correct
- No pre-validation layer to catch errors early
Planned Tasks
This work is broken down into focused sub-issues:
- Enhance MCP tool schema documentation - Add clear parameter descriptions with examples
- Improve MCP error messages - Provide actionable guidance when validation fails
- Add parameter validation tests - Ensure schema changes prevent regressions
- Monitor and verify fix - Track success rate improvement over 7 days
Success Criteria
-
add_commentfailure rate drops below 1% - MCP tool schemas include clear examples for all required parameters
- Error messages include actionable guidance and examples
- Validation tests prevent future schema regressions
References
- Source discussion: 🏥 Safe Output Health Report - 2025-12-27 #7934
- Affected workflow: Issue Monster
- Affected runs: §20544816015, §20538094622
AI generated by Plan Command for discussion #7934