Skip to content

feat(skills): add diagnose skill for AI workflow health check 🤖🤖🤖#1622

Merged
aaronpowell merged 1 commit intogithub:stagedfrom
alfersugo:add-diagnose-skill
May 6, 2026
Merged

feat(skills): add diagnose skill for AI workflow health check 🤖🤖🤖#1622
aaronpowell merged 1 commit intogithub:stagedfrom
alfersugo:add-diagnose-skill

Conversation

@alfersugo
Copy link
Copy Markdown
Contributor

Summary

Adds a new diagnose skill for systematically auditing AI workflow quality across 5 dimensions.

What this skill does

Performs a structured diagnostic scan and produces a scored report with prioritized remediation actions.

5 dimensions:

  1. Prompt Quality — structure, output schema, clarity, edge cases
  2. Context Efficiency — budget allocation, attention gradient, state management
  3. Tool Health — count, description quality, error handling, idempotency
  4. Architecture Fitness — topology, agent boundaries, handoff protocols, observability
  5. Safety & Reliability — input validation, output filtering, cost controls, error recovery

Output: ASCII box report with 1–5 scores per dimension, overall score (X/25), critical findings, and ranked remediation actions.

Usage trigger

Invoke when a user wants to:

  • Find hidden problems before a workflow goes to production
  • Audit an existing agent for quality and reliability
  • Get a prioritized remediation plan
  • Health-check a workflow after significant changes

Validation

  • npm run skill:validate ✅ passes
  • npm run build ✅ docs updated

Copilot AI review requested due to automatic review settings May 5, 2026 07:23
@alfersugo alfersugo requested a review from aaronpowell as a code owner May 5, 2026 07:23
@github-actions github-actions Bot added new-submission PR adds at least one new contribution skills PR touches skills labels May 5, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 5, 2026

🔍 Skill Validator Results

✅ All checks passed

Scope Checked
Skills 1
Agents 1
Total 2
Severity Count
--- ---:
❌ Errors 0
⚠️ Warnings 0
ℹ️ Advisories 0

Summary

Level Finding
ℹ️ Found 1 skill(s)
ℹ️ [diagnose] 📊 diagnose: 983 BPE tokens [chars/4: 1,005] (detailed ✓), 9 sections, 1 code blocks
ℹ️ ✅ All checks passed (1 skill(s))
Full validator output ```text Found 1 skill(s) [diagnose] 📊 diagnose: 983 BPE tokens [chars/4: 1,005] (detailed ✓), 9 sections, 1 code blocks ✅ All checks passed (1 skill(s)) ```

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds a new diagnose skill to the skills catalog so Copilot can audit AI workflows across prompt, context, tooling, architecture, and safety dimensions, and updates the generated skills index accordingly.

Changes:

  • Adds skills/diagnose/SKILL.md with the new diagnostic workflow, scoring rubric, and report template.
  • Defines the five evaluation dimensions and a sample scored report/output format.
  • Updates docs/README.skills.md to include the new skill in the generated skills table.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 3 comments.

File Description
skills/diagnose/SKILL.md New skill definition for AI workflow diagnostics, including front matter, scoring guidance, and output template.
docs/README.skills.md Adds the generated catalog entry for the new diagnose skill.

Comment thread skills/diagnose/SKILL.md
@@ -0,0 +1,106 @@
---
name: diagnose
description: "Perform a systematic diagnostic scan of an AI workflow across 5 quality dimensions — prompt quality, context efficiency, tool health, architecture fitness, and safety — producing a scored report with prioritized remediation actions."
Comment thread skills/diagnose/SKILL.md
Comment on lines +61 to +84
## Diagnostic Report Format

```text
╔══════════════════════════════════════╗
║ WORKFLOW DIAGNOSTIC ║
╠══════════════════════════════════════╣
║ Prompt Quality ████░ 4/5 ║
║ Context Efficiency ███░░ 3/5 ║
║ Tool Health ██░░░ 2/5 ║
║ Architecture ████░ 4/5 ║
║ Safety & Reliability ██░░░ 2/5 ║
╠══════════════════════════════════════╣
║ Overall Score: 15/25 ║
╚══════════════════════════════════════╝

CRITICAL FINDINGS:
1. [Most severe issue — immediate action needed]
2. [Second most severe]
3. [Third]

RECOMMENDED ACTIONS:
1. [Specific remediation for finding #1]
2. [Specific remediation for finding #2]
3. [Specific remediation for finding #3]
Comment thread skills/diagnose/SKILL.md
Comment on lines +63 to +74
```text
╔══════════════════════════════════════╗
║ WORKFLOW DIAGNOSTIC ║
╠══════════════════════════════════════╣
║ Prompt Quality ████░ 4/5 ║
║ Context Efficiency ███░░ 3/5 ║
║ Tool Health ██░░░ 2/5 ║
║ Architecture ████░ 4/5 ║
║ Safety & Reliability ██░░░ 2/5 ║
╠══════════════════════════════════════╣
║ Overall Score: 15/25 ║
╚══════════════════════════════════════╝
@aaronpowell aaronpowell merged commit 7f59e01 into github:staged May 6, 2026
15 of 16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

new-submission PR adds at least one new contribution skills PR touches skills

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants