Skip to content

docs(examples): fix doc link paths on agent-observability-docs.splunk.com (HYBIM-932 follow-up) - #192

Open
shuningc wants to merge 3 commits into
mainfrom
update-examples-doc-link-paths
Open

docs(examples): fix doc link paths on agent-observability-docs.splunk.com (HYBIM-932 follow-up)#192
shuningc wants to merge 3 commits into
mainfrom
update-examples-doc-link-paths

Conversation

@shuningc

@shuningc shuningc commented Jul 30, 2026

Copy link
Copy Markdown
Contributor

Summary

Follow-up to #181, which swapped example doc links from docs.galileo.ai to agent-observability-docs.splunk.com. That domain-only change left several paths returning 404 after upstream docs restructures (august-rebrand-updates in agent-observability-docs):

  • Metrics → evaluatorsconcepts/metrics/… moved under concepts/evaluators/…
  • Galileo → Splunk AO slugs — e.g. setup-galileo-mcpsetup-splunk-ao-mcp, add-galileo-to-crewaiadd-splunk-ao-to-crewai (no redirects added upstream yet)
  • Experimentsconcepts/experiments/overviewsdk-api/experiments/experiments
    This PR updates the broken example README links to match the current docs site and fixes a Windows CI failure unrelated to the doc changes.

Documentation link fixes (9 README files)

Old path New path Files
concepts/metrics/response-quality/instruction-adherence concepts/evaluators/response-quality/instruction-adherence 3× chatbot sample-project READMEs
concepts/metrics/response-quality/correctness concepts/evaluators/response-quality/correctness 3× chatbot sample-project READMEs
concepts/metrics/metric-comparison concepts/evaluators/evaluator-comparison examples/experiments/multi-turn/README.md
concepts/metrics/custom-metrics/custom-metrics-ui-llm concepts/evaluators/custom-evaluators/custom-evaluators-ui-llm examples/experiments/upload_experiment/README.md
concepts/experiments/overview sdk-api/experiments/experiments examples/agent/langgraph-fsi-agent/README.md
getting-started/mcp/setup-galileo-mcp getting-started/mcp/setup-splunk-ao-mcp examples/logging-samples/log-mcp-calls/README.md
how-to-guides/…/add-galileo-to-crewai/add-galileo-to-crewai how-to-guides/…/add-splunk-ao-to-crewai/add-splunk-ao-to-crewai examples/agent/crewAI/README.md, research_crew/README.md
All 32 unique agent-observability-docs.splunk.com URLs referenced in this repo were verified (HTTP 200). Remaining root / links redirect correctly and were left unchanged.

CI workflow fix (.github/workflows/ci-tests.yaml)

On windows-latest, pipx install invoke succeeds but invoke is not on the PowerShell PATH, causing invoke type-check / invoke test-report-xml to fail. invoke is already a Poetry dev dependency, so the workflow now:

  • Removes the separate pipx install invoke step
  • Runs poetry install --all-extras --no-root (replacing invoke install)
  • Runs poetry run invoke type-check and poetry run invoke test-report-xml

Context

Test plan

  • Grep: no remaining docs.galileo.ai, concepts/metrics/, or galileo-branded doc slugs in example READMEs
  • HTTP check: 32/32 agent-observability-docs.splunk.com URLs return 200
  • Local cross-check: all non-root URLs match .mdx paths in agent-observability-docs main
  • CI: verify CI - Test passes on Ubuntu, macOS, and Windows (especially Python matrix on windows-latest)

….com

The new docs site moved metrics content under concepts/evaluators/.
Update six example README links that 404'd after the domain-only swap,
and point experiments docs at the canonical sdk-api path.

Co-authored-by: Cursor <cursoragent@cursor.com>
@shuningc
shuningc marked this pull request as ready for review July 30, 2026 19:08
@shuningc
shuningc marked this pull request as draft July 30, 2026 19:10
pipx-installed invoke is not on PATH in PowerShell on windows-latest,
causing invoke test-report-xml to fail. Use poetry run invoke instead
since invoke is already a dev dependency.

Co-authored-by: Cursor <cursoragent@cursor.com>
@shuningc
shuningc force-pushed the update-examples-doc-link-paths branch from 4ceb257 to 03f88ab Compare July 30, 2026 19:18
@shuningc
shuningc marked this pull request as ready for review July 30, 2026 19:28
Update MCP setup and CrewAI integration links to match the Splunk AO
slugs in agent-observability-docs (setup-splunk-ao-mcp, add-splunk-ao-to-crewai).

Co-authored-by: Cursor <cursoragent@cursor.com>

@fercor-cisco fercor-cisco left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🤖 This review was generated by the Astra agent (claude-opus-4-8). It may contain mistakes.

Verdict: needs_discussion — Diff contradicts the PR description on which links were changed, and includes an undocumented out-of-scope CI change; URL correctness could not be independently verified.

General Comments

  • 🟠 major (question): The diff contradicts the PR description. The description explicitly lists these URLs under "Not changed — verified as 200 OK on the new domain with existing paths — no edits needed":
  • .../add-galileo-to-crewai/add-galileo-to-crewai
  • .../getting-started/mcp/setup-galileo-mcp

But the diff rewrites all three occurrences to add-splunk-ao-to-crewai/add-splunk-ao-to-crewai (crewAI/README.md, research_crew/README.md ×2) and setup-splunk-ao-mcp (log-mcp-calls/README.md). For a PR whose sole purpose is fixing link paths, this is a direct inconsistency: either the description's "200 OK, no edits" claim is stale, or these edits change links that already worked and now risk 404s. Please confirm the current resolution status of both the old (galileo) and new (splunk-ao) slugs and reconcile the description with the diff. (I could not verify the URLs from this environment — the docs domain is not fetchable here.)

Comment on lines 55 to +56
- name: Install Dependencies
run: invoke install
run: poetry install --all-extras --no-root

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 minor (design): This CI workflow change (removing the pipx install invoke step, switching invoke installpoetry install --all-extras --no-root, and prefixing poetry run to the invoke calls) is unrelated to the PR's stated purpose (docs(examples): fix doc link paths) and is not mentioned anywhere in the description. The change itself looks functionally correct — invoke is declared in the Poetry dev group, so poetry run invoke type-check / poetry run invoke test-report-xml resolve after poetry install. But this scope creep should either be split into its own PR or called out explicitly in the description so reviewers know to evaluate it.

🤖 Generated by the Astra agent

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated the PR description to match the changes. The CI workflow is to fix one of the failed pipeline for this PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants