Skip to content

feat(ai-mcp, ai-acp, ai-code-mode, ai-skills, ai-harness-cli, ai-harness): integrations on the new harness, with MCP reconnects, ACP order, a skills watcher per host, and a CLI that cancels at once - #1822

Merged
AlemTuzlak merged 17 commits into
feat/harness-reportingfrom
feat/harness-integrations
Oct 19, 2026

Conversation

@AlemTuzlak

@AlemTuzlak AlemTuzlak commented Oct 18, 2026 •

Copy link
Copy Markdown
Contributor

The integrations now run on the new harness primitives. MCP servers reconnect and refresh their tools, ACP keeps prompt order, code mode never hides an approval, skills share one watcher per host, the CLI cancels at once, and harnessText acts for the caller. This is PR 12 of the harness redesign stack for #1755. It targets #1821 (feat/harness-reporting). PRs 12, 13, and 14 are chained (13 on 12, 14 on 13), so each one merges cleanly in order.

🎯 Changes

  • @tanstack/ai-mcp: the mcp() plugin.
    • It connects again with backoff when a server closes, and lists tools again on list_changed.
    • Each server takes needsApproval and toolName. When two servers give a tool with the same name, mcp() warns once.
    • Live elicitations are tracked per server, so each question goes to the run that called the tool.
  • @tanstack/ai-acp. A prompt takes its place in the queue before its media is saved, so prompts keep their order. An idle session gives its place back.
  • @tanstack/ai-code-mode. include never moves a tool into code mode when it needs approval or when the rules deny it or ask about it.
  • @tanstack/ai-skills. One folder watcher per host, with a cache that a change clears, and a fallback message for a skill that does not load.
  • @tanstack/ai-harness-cli.
    • In a terminal, /cancel and a message typed while a turn runs act at once. Line mode no longer waits for idle.
    • loadOptional reports real load errors.
    • --dashboard is removed. Waits use exit code 3 (from PR 7).
  • harnessText.
    • It uses the principal of each call, and an abort on a remote harness sends a cancel.
    • The inner usage reaches the outer RUN_FINISHED, and its SSE reader takes multi-line data: and CRLF.
    • It shares one forwarding path with harnessAgent.

The wait mapping that the plan put here for ACP, the MCP server, and the CLI was already built in PR 7 (#1817), so this PR does not repeat it.

Docs: mcp, acp, code-mode, skills, cli, and connect under docs/harness/. The changesets for @tanstack/ai-mcp, @tanstack/ai-acp, @tanstack/ai-code-mode, @tanstack/ai-skills, @tanstack/ai-harness-cli, and @tanstack/ai-harness are edited in place.

✅ Checklist

  • I have followed the steps in the Contributing guide.
  • I have tested code changes locally with pnpm run test:pr, or these tests do not apply to this pull request.
  • I fully understand the code in this pull request, including any code generated with AI assistance.
  • Docs: I updated docs/ for this change, or this change is not user-facing.
  • Changeset: I added a changeset (pnpm changeset), or this PR does not change a published package.

🚀 Release Impact

  • This change affects published code, and I have generated a changeset.
  • This change is docs/CI/dev-only (no release).

Testing

Commands run:

  1. Builds of the E2E app's dependencies and the CLI. test:types of ai, ai-harness, ai-mcp, ai-acp, ai-harness-cli, ai-code-mode, ai-skills, ai-sandbox, and the E2E app. All pass.
  2. vitest related on the changed files, with --maxWorkers=2. In ai-harness: 127 files and 1,568 tests. In the other packages: ai-mcp 17 files, ai-acp 4, ai-code-mode 1, ai-skills 1, ai-harness-cli 7. All pass.
  3. test:oxlint of ai-harness, test:knip, pnpm test:docs, and oxfmt --check on every changed file.

Not run locally: E2E and coverage. CI runs them.

Manual test:

  1. Run pnpm --dir packages/ai-mcp exec vitest run tests/harness-reconnect.test.ts tests/harness-plugin.test.ts.
  2. Run pnpm --dir packages/ai-harness-cli exec vitest run tests/cli.test.ts, and read "line mode in a terminal": a /cancel typed during a turn stops it at once.

How this PR makes testing easy: the new and updated tests in each package pin each change: harness-reconnect for MCP, the ACP agent tests, the code-mode harness tests, the skills watcher tests, and the CLI line-mode tests.

Risk / rollback

Low to medium. Each change is in one integration package. The CLI's --dashboard is gone, and the harness and CLI are not released yet. To undo, revert this PR.

Public API change

Before

mcp({ servers: { docs: { url } } })

After

mcp({ servers: { docs: { url, needsApproval: (tool) => tool.annotations?.readOnlyHint !== true, toolName: (tool) => `docs_${tool.name}` } } })

Review fixes

These fixes come from a stack review. #1823 to #1825 are already squash-merged into this branch. This PR is squash-merged into #1821 next.

  • MCP: there is no reconnect timer after host.close(). The backoff resets only after 30 s of a stable connection. New option mcp({ onDuplicateTool: 'warn' | 'error' }), default 'warn'.
  • harnessText: the inner thread is <outer>/inner/<harness> on every host. Access is checked through the outer thread only when the inner entry links to that outer thread. App code cannot open /inner/ ids. The run principal is passed on as it is.
  • ACP keeps the sessions of its connection known on a host with no session index.
  • The CLI tells a missing optional package by its resolve error code, not the message text.
  • Skills: one shared watcher per host that only triggers a sync. The skill cache is gone.

Checks: the unit tests for the changed files, plus test:types and test:oxlint for ai-mcp, ai-harness-cli, ai-harness, ai-acp and ai-skills. CI runs the rest.

…t_changed, and takes needsApproval and toolName per server
…eases idle sessions, code mode never moves approval tools, harnessText acts for the caller
…dOptional reports real errors, and --dashboard goes away
# Conflicts:
#	.changeset/ai-harness-cli.md
#	packages/ai-harness-cli/src/lines.ts
#	packages/ai-harness-cli/tests/cli.test.ts
#	packages/ai-harness/src/harness-text.ts
#	packages/ai-mcp/src/harness-plugin.ts
@changeset-bot

changeset-bot Bot commented Oct 18, 2026 •

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: ccda7e3

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 69 packages
Name Type
@tanstack/ai-harness-cli Minor
@tanstack/ai-harness Minor
@tanstack/ai-mcp Minor
@tanstack/ai-sandbox Minor
@tanstack/ai Minor
@tanstack/ai-code-mode Minor
@tanstack/ai-acp Minor
@tanstack/ai-skills Minor
@tanstack/ai-claude-code Patch
@tanstack/ai-codex Patch
@tanstack/ai-durable-stream Patch
@tanstack/ai-grok-build Patch
@tanstack/ai-opencode Patch
@tanstack/ai-sandbox-blaxel Patch
@tanstack/ai-sandbox-boxd Patch
@tanstack/ai-sandbox-cloudflare Patch
@tanstack/ai-sandbox-daytona Patch
@tanstack/ai-sandbox-docker Patch
@tanstack/ai-sandbox-e2b Patch
@tanstack/ai-sandbox-local-process Patch
@tanstack/ai-sandbox-railway Patch
@tanstack/ai-sandbox-sprites Patch
@tanstack/ai-sandbox-upstash-box Patch
@tanstack/ai-sandbox-vercel Patch
@tanstack/ai-angular Patch
@tanstack/ai-anthropic Patch
@tanstack/ai-bedrock Patch
@tanstack/ai-byteplus Patch
@tanstack/ai-client Patch
@tanstack/ai-cloudflare Patch
@tanstack/ai-code-mode-snippets Patch
@tanstack/ai-cohere Patch
@tanstack/ai-compaction Patch
@tanstack/ai-devtools-core Patch
@tanstack/ai-elevenlabs Patch
@tanstack/ai-fal Patch
@tanstack/ai-gemini Patch
@tanstack/ai-grok Patch
@tanstack/ai-groq Patch
@tanstack/ai-isolate-e2b Patch
@tanstack/ai-llmgateway Patch
@tanstack/ai-lovable Patch
@tanstack/ai-memory Patch
@tanstack/ai-mistral Patch
@tanstack/ai-octane Patch
@tanstack/ai-ollama Patch
@tanstack/ai-ollaya Patch
@tanstack/ai-openai Patch
@tanstack/ai-openrouter Patch
@tanstack/ai-perplexity Patch
@tanstack/ai-persistence Patch
@tanstack/ai-preact Patch
@tanstack/ai-react Patch
@tanstack/ai-reactor Patch
@tanstack/ai-remix Patch
@tanstack/ai-solid Patch
@tanstack/ai-svelte Patch
@tanstack/ai-typesafe Patch
@tanstack/ai-vercel-gateway Patch
@tanstack/ai-vertex Patch
@tanstack/ai-vue Patch
@tanstack/ai-worldlabs Patch
@tanstack/openai-base Patch
@tanstack/ai-isolate-cloudflare Patch
@tanstack/ai-isolate-daytona Patch
@tanstack/ai-isolate-node Patch
@tanstack/ai-isolate-quickjs-bun Patch
@tanstack/ai-isolate-quickjs Patch
ag-ui Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@coderabbitai

coderabbitai Bot commented Oct 18, 2026 •

Copy link
Copy Markdown
Contributor

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration
  • Configuration used: Repository: TanStack/ai/.coderabbit.yaml
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 59d49107-6d3d-47a0-b6f1-ab1bf17261bb

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@nx-cloud

nx-cloud Bot commented Oct 18, 2026 •

Copy link
Copy Markdown

View your CI Pipeline Execution ↗ for commit 7ab3b63

Command Status Duration Result
nx build @tanstack/ai-isolate-quickjs-bun ✅ Succeeded 16s View ↗

☁️ Nx Cloud last updated this comment at 2026-10-19 10:16:43 UTC

@pkg-pr-new

pkg-pr-new Bot commented Oct 18, 2026 •

Copy link
Copy Markdown

Open in StackBlitz

@tanstack/ai

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai@1822

@tanstack/ai-acp

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-acp@1822

@tanstack/ai-angular

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-angular@1822

@tanstack/ai-anthropic

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-anthropic@1822

@tanstack/ai-bedrock

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-bedrock@1822

@tanstack/ai-byteplus

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-byteplus@1822

@tanstack/ai-claude-code

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-claude-code@1822

@tanstack/ai-client

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-client@1822

@tanstack/ai-cloudflare

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-cloudflare@1822

@tanstack/ai-code-mode

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-code-mode@1822

@tanstack/ai-code-mode-snippets

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-code-mode-snippets@1822

@tanstack/ai-codex

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-codex@1822

@tanstack/ai-cohere

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-cohere@1822

@tanstack/ai-compaction

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-compaction@1822

@tanstack/ai-devtools-core

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-devtools-core@1822

@tanstack/ai-durable-stream

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-durable-stream@1822

@tanstack/ai-elevenlabs

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-elevenlabs@1822

@tanstack/ai-event-client

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-event-client@1822

@tanstack/ai-fal

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-fal@1822

@tanstack/ai-gemini

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-gemini@1822

@tanstack/ai-grok

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-grok@1822

@tanstack/ai-grok-build

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-grok-build@1822

@tanstack/ai-groq

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-groq@1822

@tanstack/ai-harness

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-harness@1822

@tanstack/ai-harness-cli

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-harness-cli@1822

@tanstack/ai-isolate-cloudflare

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-isolate-cloudflare@1822

@tanstack/ai-isolate-daytona

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-isolate-daytona@1822

@tanstack/ai-isolate-e2b

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-isolate-e2b@1822

@tanstack/ai-isolate-node

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-isolate-node@1822

@tanstack/ai-isolate-quickjs

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-isolate-quickjs@1822

@tanstack/ai-isolate-quickjs-bun

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-isolate-quickjs-bun@1822

@tanstack/ai-llmgateway

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-llmgateway@1822

@tanstack/ai-lovable

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-lovable@1822

@tanstack/ai-mcp

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-mcp@1822

@tanstack/ai-memory

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-memory@1822

@tanstack/ai-mistral

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-mistral@1822

@tanstack/ai-octane

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-octane@1822

@tanstack/ai-ollama

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-ollama@1822

@tanstack/ai-ollaya

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-ollaya@1822

@tanstack/ai-openai

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-openai@1822

@tanstack/ai-opencode

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-opencode@1822

@tanstack/ai-openrouter

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-openrouter@1822

@tanstack/ai-perplexity

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-perplexity@1822

@tanstack/ai-persistence

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-persistence@1822

@tanstack/ai-preact

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-preact@1822

@tanstack/ai-react

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-react@1822

@tanstack/ai-react-ui

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-react-ui@1822

@tanstack/ai-reactor

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-reactor@1822

@tanstack/ai-remix

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-remix@1822

@tanstack/ai-sandbox

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-sandbox@1822

@tanstack/ai-sandbox-blaxel

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-sandbox-blaxel@1822

@tanstack/ai-sandbox-boxd

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-sandbox-boxd@1822

@tanstack/ai-sandbox-cloudflare

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-sandbox-cloudflare@1822

@tanstack/ai-sandbox-daytona

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-sandbox-daytona@1822

@tanstack/ai-sandbox-docker

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-sandbox-docker@1822

@tanstack/ai-sandbox-e2b

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-sandbox-e2b@1822

@tanstack/ai-sandbox-local-process

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-sandbox-local-process@1822

@tanstack/ai-sandbox-railway

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-sandbox-railway@1822

@tanstack/ai-sandbox-sprites

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-sandbox-sprites@1822

@tanstack/ai-sandbox-upstash-box

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-sandbox-upstash-box@1822

@tanstack/ai-sandbox-vercel

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-sandbox-vercel@1822

@tanstack/ai-skills

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-skills@1822

@tanstack/ai-solid

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-solid@1822

@tanstack/ai-solid-ui

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-solid-ui@1822

@tanstack/ai-svelte

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-svelte@1822

@tanstack/ai-typesafe

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-typesafe@1822

@tanstack/ai-utils

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-utils@1822

@tanstack/ai-vercel-gateway

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-vercel-gateway@1822

@tanstack/ai-vertex

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-vertex@1822

@tanstack/ai-vue

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-vue@1822

@tanstack/ai-vue-ui

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-vue-ui@1822

@tanstack/ai-worldlabs

npm i https://pkg.pr.new/TanStack/ai/@tanstack/ai-worldlabs@1822

@tanstack/openai-base

npm i https://pkg.pr.new/TanStack/ai/@tanstack/openai-base@1822

@tanstack/preact-ai-devtools

npm i https://pkg.pr.new/TanStack/ai/@tanstack/preact-ai-devtools@1822

@tanstack/react-ai-devtools

npm i https://pkg.pr.new/TanStack/ai/@tanstack/react-ai-devtools@1822

@tanstack/solid-ai-devtools

npm i https://pkg.pr.new/TanStack/ai/@tanstack/solid-ai-devtools@1822

@tanstack/svelte-ai-devtools

npm i https://pkg.pr.new/TanStack/ai/@tanstack/svelte-ai-devtools@1822

commit: 7ab3b63

@github-actions

Copy link
Copy Markdown
Contributor

Coverage

✅ Coverage held across 30 compared package(s).

Each package is measured twice in this job — on this PR and on its merge-base with main — and compared. A metric fails only when it is at or above 60% on the merge-base and under 60% on this PR. Other drops are listed but do not fail. Packages your PR doesn't affect are not measured and not listed.

package statements branches functions lines
ai-acp 82.69% (+0.09) 71.04% (-0.06) 78.63% (+0.39) 84.72% (+0.18) ok
ai-claude-code 88.93% (0.00) 76.88% (0.00) 86.88% (0.00) 90.40% (0.00) ok
ai-code-mode 93.04% (+0.33) 86.07% (+0.41) 89.55% (+0.49) 93.76% (+0.25) ok
ai-code-mode-snippets 87.13% (0.00) 75.67% (0.00) 91.11% (0.00) 88.39% (0.00) ok
ai-codex 94.55% (0.00) 85.10% (0.00) 89.28% (0.00) 95.56% (0.00) ok
ai-durable-stream 86.70% (0.00) 82.25% (0.00) 92.30% (0.00) 88.72% (0.00) ok
ai-grok-build 79.19% (0.00) 63.56% (0.00) 77.39% (0.00) 81.02% (0.00) ok
ai-harness 93.28% (+0.02) 87.17% (-0.03) 93.30% (+0.02) 95.05% (+0.02) ok
ai-harness-cli 91.90% (+1.09) 82.77% (+0.08) 88.00% (+1.52) 92.94% (+1.03) ok
ai-isolate-cloudflare 94.11% (0.00) 70.66% (0.00) 100.00% (0.00) 93.96% (0.00) ok
ai-isolate-daytona 90.25% (0.00) 80.59% (0.00) 100.00% (0.00) 90.15% (0.00) ok
ai-isolate-e2b 92.11% (0.00) 81.48% (0.00) 97.36% (0.00) 95.05% (0.00) ok
ai-isolate-node 84.00% (0.00) 43.39% (0.00) 100.00% (0.00) 83.78% (0.00) ok
ai-isolate-quickjs 89.07% (0.00) 76.41% (0.00) 90.90% (0.00) 90.30% (0.00) ok
ai-isolate-quickjs-bun 7.76% (0.00) 8.08% (0.00) 5.00% (0.00) 8.33% (0.00) ok
ai-mcp 96.36% (-0.30) 91.24% (-0.08) 96.67% (-0.42) 98.28% (-0.24) ok
ai-opencode 69.04% (0.00) 60.82% (0.00) 65.26% (0.00) 70.87% (0.00) ok
ai-sandbox 78.48% (-0.06) 83.00% (-0.04) 75.63% (-0.11) 79.05% (-0.04) ok
ai-sandbox-blaxel 87.64% (0.00) 77.18% (0.00) 82.26% (0.00) 89.71% (0.00) ok
ai-sandbox-boxd 95.86% (0.00) 87.12% (0.00) 95.31% (0.00) 98.17% (0.00) ok
ai-sandbox-cloudflare 67.91% (0.00) 57.47% (0.00) 71.79% (0.00) 69.62% (0.00) ok
ai-sandbox-daytona 82.70% (0.00) 81.89% (0.00) 67.14% (0.00) 85.18% (0.00) ok
ai-sandbox-docker 80.15% (0.00) 71.49% (0.00) 77.38% (0.00) 82.13% (0.00) ok
ai-sandbox-e2b 94.42% (0.00) 88.97% (0.00) 93.24% (0.00) 98.63% (0.00) ok
ai-sandbox-local-process 69.43% (0.00) 54.01% (0.00) 77.27% (0.00) 70.27% (0.00) ok
ai-sandbox-railway 94.75% (0.00) 92.68% (0.00) 90.90% (0.00) 97.59% (0.00) ok
ai-sandbox-sprites 73.23% (0.00) 59.70% (0.00) 73.83% (0.00) 76.17% (0.00) ok
ai-sandbox-upstash-box 94.82% (0.00) 91.52% (0.00) 91.04% (0.00) 97.76% (0.00) ok
ai-sandbox-vercel 44.67% (0.00) 38.18% (0.00) 35.18% (0.00) 45.76% (0.00) ok
ai-skills 83.98% (+0.39) 68.19% (-0.39) 88.51% (+1.15) 86.02% (+0.39) ok

@github-actions
github-actions Bot requested a review from jherr October 18, 2026 15:55
@github-actions github-actions Bot added the waiting-on: maintainer The ball is in the maintainers’ court label Oct 18, 2026
@tombeckenham
tombeckenham added this pull request to stack #1826 October 18, 2026 21:20
@AlemTuzlak
AlemTuzlak removed this pull request from stack #1826 October 19, 2026 09:07
…lient, and host-event paths, no idle store calls, and context prompts after the history (#1823)

* perf(ai-harness): cache plugin lists and permission patterns, read instruction files async, parse SSE as a stream with one abort listener and capped backoff, and give each control input an id

* perf(ai-harness): stream media, cache base64 parts across turns, cap open-ended ranges, and add a byte-capped event ring

* perf(ai-harness, ai-harness-cli): the view and the printer only redo what changed, children load on demand with view.loadAgent, operation.stream reads from its start

* perf(ai-harness): ring buffer log tail, joins and rebuilt operations read from the run start, a per-tenant host event bus, no MESSAGES_SNAPSHOT in the log, and no idle store calls

* perf(ai-harness): plugin prompts with placement 'context' go after the history, so the cached prompt prefix stays valid

* test(ai-harness): one threadId in the expected gap frame

* test(e2e): the first-party fixtures match the context prompt that now comes after the user message

* fix(ai, ai-harness): a guard tier for tool calls, complete plugin removal, media and body limits, signing keys, and turn and config fixes (#1824)

* fix(ai-harness): a settled operation keeps its status, a media signer with key rotation, and agents() rule docs that match the code

* fix(ai-harness): every plugin contribution has an owner, ctx.on cleans up, inline media goes to the media store, and capabilities report the socket only when mounted

* docs(ai-harness): say when capabilities report the WebSocket

* feat(ai): onGuardToolCall middleware hook that runs on the final arguments of every tool call

* test(e2e): onGuardToolCall denies on the final args after a transformArgs

* fix(ai-harness): tool turns take no steers, a turn keeps its config, removing a plugin removes all of it, body and frame limits, signing keys, and a warning on tool name clashes

* fix(ai-harness): the media signer's key check covers an empty secret

* fix(ai-harness-cli): serve signs media URLs with a key derived from the token, so a short token meets the 32-byte key rule

* feat(ai-harness, ai-mcp, ai-acp, ai-code-mode, ai-harness-cli): the final review of the harness, with its fixes, one object per call, and the known limits (#1825)

* fix(ai-harness, ai-mcp, ai-acp, ai-code-mode): final review fixes for durability, access, plugins, transports, integrations, and coding tools

* fix(ai-acp): one agent app serves one connection, with editor capabilities read from that connection, and no private SDK field

* fix(ai-harness): a thread delete ends it in first-party plugins, the bash spill is scrubbed, removed schedules go at once, agent run receipts resolve, and session.append takes one object with an optional inputId

* refactor(ai-harness, ai-mcp, ai-harness-cli): session, client, and view methods take one object, the client and view use putMedia and client.sessions, and internal fields leave the public types

* docs(ai-harness, ai-mcp, ai-acp, ai-code-mode): the final review changes, the fixed durable-tools and server-tools text, and a known limits section

* fix(ai-harness): revoke and unshare reject when work does not stop, thread delete reaches child logs and known harnesses, plugins declare kept records, and the review fixes

- host.revoke and host.sessions.unshare reject when the work stop fails
  (the access is gone already). unshare ends the reads before it stops
  the work.
- createHarnessHost takes harnesses, so a delete on a new host ends the
  thread in its plugins. An unknown harness warns. A child thread ends in
  the log of its root.
- A plugin declares keepRecords. The core fold reads them from the
  plugins of the harness that folds the log, and counts per type.
  snapshots() keeps its 500 steps this way.
- revert and unrevert open the workspace of the thread from the log when
  no turn opened it on this host.
- The harness.revert and harness.job records keep the principal.
- append with no inputId goes through accept(), so its id is real.
- A formatter config below the root, or a write under node_modules, asks
  again.
- The base64 cache takes the largest encodedBytes. The client takes
  idleTimeoutMs.
- An events() read listens for a revoke from the call, not the first pull.

* docs(ai-harness): the harnesses option, keepRecords, idleTimeoutMs, a revoke that rejects, and one known limit less

* feat(ai-harness): ctx.session.keptRecords reads the kept records of a plugin, and session.revert reads them the same way

* fix(ai-harness): an always answer saves no rule for an @unsaved: action

* refactor(ai-harness): mounted plugins keep each contribution list with its owner, not in parallel owner arrays

* fix(ai-harness): a plugins remove setting is rejected when a kept turn plugin or a harness middleware needs the removed capability

* fix(ai-harness): client media checks every part before it stores any, refuses provider file handles unless media.allowProviderFiles, and the frame limit docs name the server maxPayload

* fix(ai-harness): a retried client input with inline media reuses the stored media, so it stores nothing again and is a duplicate, not a conflict

* docs(ai-harness): routed root-agent turns take steers and late joins, only session.tool() turns do not

* fix(ai-harness-cli): --serve signs media URLs with --media-key or HARNESS_MEDIA_KEY, or a random key, never with the bearer token

* fix(ai-harness): keep the usage source in the view, and a host events read that listens from the call

* fix(ai-harness): send context prompts as the last system prompt, not as a user message

* fix(ai-harness): check the snapshot shape in client.events(), and document its head-first default

* feat(ai-harness): an onTurnStart plugin hook, used by projectInstructions and workspaceTools

* fix(ai-harness): keep the interrupt messages snapshot in the log, so a rejoin from the log gets it

* fix(ai-harness-cli): load the saved child agents in the TUI example, and document view.loadAgent for a ui
…uter thread, and pass the run principal on as is
@AlemTuzlak
AlemTuzlak merged commit 0dd6227 into feat/harness-reporting Oct 19, 2026
9 of 11 checks passed
@AlemTuzlak
AlemTuzlak deleted the feat/harness-integrations branch October 19, 2026 10:47
AlemTuzlak added a commit that referenced this pull request Oct 19, 2026
…eams, run tags, lifecycle events, usage by source, and tracing (#1821)

* feat(ai-harness, ai): protocol v2 frames with error codes and request ids, observability types, and pull-based SSE and socket senders

* docs(ai-harness): first draft of the harness protocol page

* feat(ai-harness): one wire encoding on every transport with hello, version, request ids, and heartbeats; hooks and status from other hosts; a gap event for evicted feeds

* test(e2e): the access spec skips the hello frame of the session stream

* feat(ai-harness): a grouped stream option for the heartbeat, the slow-consumer close, and the SSE and socket buffer limits

* feat(ai-harness): run tags on every event frame, ctx.model.chat for plugins, and usage by source

* feat(ai-harness): lifecycle events, counted router and transfer model calls, tracing with span links, and onOperation reports

* docs(ai-harness): the harness protocol page, keeping the stream open, stopping a turn from useChat, and the changesets for reporting and observability

* docs(ai-harness): run tags and the gap reload in the custom UI page

* test(e2e): the wire, the gap, the run tree in one stream, lifecycle events, tracing, remote status, cancel from another host, and an unsupported version

* test(ai-harness): give polled checks room for slower CI coverage runs

* feat(ai-mcp, ai-acp, ai-code-mode, ai-skills, ai-harness-cli, ai-harness): integrations on the new harness, with MCP reconnects, ACP order, a skills watcher per host, and a CLI that cancels at once (#1822)

* feat(ai-mcp): mcp() reconnects with backoff, lists tools again on list_changed, and takes needsApproval and toolName per server

* fix(ai-acp, ai-code-mode, ai-harness): ACP keeps prompt order and releases idle sessions, code mode never moves approval tools, harnessText acts for the caller

* perf(ai-skills): one folder watcher per host with a cache of the skills

* feat(ai-harness-cli): cancel and steer act at once in a terminal, loadOptional reports real errors, and --dashboard goes away

* chore(changeset): the integration changes for mcp, acp, code mode, skills, and harnessText

* perf(ai-harness, ai-harness-cli): cheaper plugin, log, media, view, client, and host-event paths, no idle store calls, and context prompts after the history (#1823)

* perf(ai-harness): cache plugin lists and permission patterns, read instruction files async, parse SSE as a stream with one abort listener and capped backoff, and give each control input an id

* perf(ai-harness): stream media, cache base64 parts across turns, cap open-ended ranges, and add a byte-capped event ring

* perf(ai-harness, ai-harness-cli): the view and the printer only redo what changed, children load on demand with view.loadAgent, operation.stream reads from its start

* perf(ai-harness): ring buffer log tail, joins and rebuilt operations read from the run start, a per-tenant host event bus, no MESSAGES_SNAPSHOT in the log, and no idle store calls

* perf(ai-harness): plugin prompts with placement 'context' go after the history, so the cached prompt prefix stays valid

* test(ai-harness): one threadId in the expected gap frame

* test(e2e): the first-party fixtures match the context prompt that now comes after the user message

* fix(ai, ai-harness): a guard tier for tool calls, complete plugin removal, media and body limits, signing keys, and turn and config fixes (#1824)

* fix(ai-harness): a settled operation keeps its status, a media signer with key rotation, and agents() rule docs that match the code

* fix(ai-harness): every plugin contribution has an owner, ctx.on cleans up, inline media goes to the media store, and capabilities report the socket only when mounted

* docs(ai-harness): say when capabilities report the WebSocket

* feat(ai): onGuardToolCall middleware hook that runs on the final arguments of every tool call

* test(e2e): onGuardToolCall denies on the final args after a transformArgs

* fix(ai-harness): tool turns take no steers, a turn keeps its config, removing a plugin removes all of it, body and frame limits, signing keys, and a warning on tool name clashes

* fix(ai-harness): the media signer's key check covers an empty secret

* fix(ai-harness-cli): serve signs media URLs with a key derived from the token, so a short token meets the 32-byte key rule

* feat(ai-harness, ai-mcp, ai-acp, ai-code-mode, ai-harness-cli): the final review of the harness, with its fixes, one object per call, and the known limits (#1825)

* fix(ai-harness, ai-mcp, ai-acp, ai-code-mode): final review fixes for durability, access, plugins, transports, integrations, and coding tools

* fix(ai-acp): one agent app serves one connection, with editor capabilities read from that connection, and no private SDK field

* fix(ai-harness): a thread delete ends it in first-party plugins, the bash spill is scrubbed, removed schedules go at once, agent run receipts resolve, and session.append takes one object with an optional inputId

* refactor(ai-harness, ai-mcp, ai-harness-cli): session, client, and view methods take one object, the client and view use putMedia and client.sessions, and internal fields leave the public types

* docs(ai-harness, ai-mcp, ai-acp, ai-code-mode): the final review changes, the fixed durable-tools and server-tools text, and a known limits section

* fix(ai-harness): revoke and unshare reject when work does not stop, thread delete reaches child logs and known harnesses, plugins declare kept records, and the review fixes

- host.revoke and host.sessions.unshare reject when the work stop fails
  (the access is gone already). unshare ends the reads before it stops
  the work.
- createHarnessHost takes harnesses, so a delete on a new host ends the
  thread in its plugins. An unknown harness warns. A child thread ends in
  the log of its root.
- A plugin declares keepRecords. The core fold reads them from the
  plugins of the harness that folds the log, and counts per type.
  snapshots() keeps its 500 steps this way.
- revert and unrevert open the workspace of the thread from the log when
  no turn opened it on this host.
- The harness.revert and harness.job records keep the principal.
- append with no inputId goes through accept(), so its id is real.
- A formatter config below the root, or a write under node_modules, asks
  again.
- The base64 cache takes the largest encodedBytes. The client takes
  idleTimeoutMs.
- An events() read listens for a revoke from the call, not the first pull.

* docs(ai-harness): the harnesses option, keepRecords, idleTimeoutMs, a revoke that rejects, and one known limit less

* feat(ai-harness): ctx.session.keptRecords reads the kept records of a plugin, and session.revert reads them the same way

* fix(ai-harness): an always answer saves no rule for an @unsaved: action

* refactor(ai-harness): mounted plugins keep each contribution list with its owner, not in parallel owner arrays

* fix(ai-harness): a plugins remove setting is rejected when a kept turn plugin or a harness middleware needs the removed capability

* fix(ai-harness): client media checks every part before it stores any, refuses provider file handles unless media.allowProviderFiles, and the frame limit docs name the server maxPayload

* fix(ai-harness): a retried client input with inline media reuses the stored media, so it stores nothing again and is a duplicate, not a conflict

* docs(ai-harness): routed root-agent turns take steers and late joins, only session.tool() turns do not

* fix(ai-harness-cli): --serve signs media URLs with --media-key or HARNESS_MEDIA_KEY, or a random key, never with the bearer token

* fix(ai-harness): keep the usage source in the view, and a host events read that listens from the call

* fix(ai-harness): send context prompts as the last system prompt, not as a user message

* fix(ai-harness): check the snapshot shape in client.events(), and document its head-first default

* feat(ai-harness): an onTurnStart plugin hook, used by projectInstructions and workspaceTools

* fix(ai-harness): keep the interrupt messages snapshot in the log, so a rejoin from the log gets it

* fix(ai-harness-cli): load the saved child agents in the TUI example, and document view.loadAgent for a ui

* fix(ai-mcp): no reconnect timer after close, backoff that survives crash loops, and onDuplicateTool 'error'

* fix(ai-harness-cli): tell a missing optional package by its resolve error code, not the message text

* fix(ai-harness): check the inner session of harnessText through the outer thread, and pass the run principal on as is

* fix(ai-harness): bind the harnessText inner thread to its outer thread before the outer check applies

* fix(ai-acp): keep the sessions of the connection known on a host with no session index

* refactor(ai-skills): one shared watcher per host that only triggers a sync, with no skill cache

* fix(ai-harness): one harnessText inner thread id shape, <outer>/inner/<harness>, on every host

* fix(ai-harness): use the real OpenTelemetry types, guard a tracer that throws, and trace a transfer inside it

@opentelemetry/api is now an optional peer (type imports, and a lazy load for
trace.setSpan when a host has a tracer). The copied span types and the private
context key are gone. A tracer or span call that throws is logged and fails no
run. The harness.transfer span is part of host.transfer, not a patch after it.

* fix(ai-harness): trim the protocol to one version check, put the parent run on RUN_STARTED, and surface harness.error in the client

- A requested version other than 2 gets unsupported_version from one
  equality check. negotiateVersion, SUPPORTED_PROTOCOL_VERSIONS, and the
  supported field are gone.
- harness.event frames and session events no longer carry parentRunId. The
  AG-UI RUN_STARTED of a child agent run has it.
- client.events() and client.hostEvents() connect again after slow_consumer
  and throw a HarnessProtocolError (code + message) for any other error frame.

* fix(ai-harness): no usage event after a run finished, and bySource on old snapshots

- A ctx.model.chat call that ends after its run settled (the title plugin)
  writes the usage record only: the run sends nothing after RUN_FINISHED.
- Usage totals from a snapshot written before bySource get an empty map at
  load, so session.usage().bySource is always an object.

* fix(ai-harness, ai-persistence): read takeover and open questions from real state, and clear the runs of a stopped owner

- LogStore.acquire returns expired: true when it takes a log from another
  owner whose ownership expired with no release. harness.ownership.changed
  says taken_over from that, not from pending inputs.
- The host status reads open questions from the folded log only.
- The status rule drops the running operations of a stopped owner on
  taken_over, and the old operation of a resumed input, so a reader host
  does not show running forever after a takeover.

* test(ai-harness): an append is an input, so a non-owner forwards it and the log has its input records

- shared-log: check that the two app records land in one store append, or
  neither, among the input records that the append now writes.
- ownership: the append of a host that does not own the log is queued and
  the owner writes it. A write that is not an input (a schedule) is still
  refused.
- docs: an append on a host that does not own the thread gets a queued
  receipt.
AlemTuzlak added a commit that referenced this pull request Oct 19, 2026
…for many threads, with workspaces per run, locks, bounded jobs, and moving threads between hosts (#1820)

* fix(ai-harness, ai-sandbox): coding commands get an env allowlist, one workspace per thread, and real paths checked under the lock

* wip: unfinished node work, saved before a shutdown (not reviewed)

* fix(ai-harness): shared file locks with an unchanged check, and snapshots per thread and per run

* fix(ai-harness, ai-sandbox, ai-sandbox-local-process): bounded background jobs with a ring buffer, a kill that waits for the spawn, workspace close, and an env allowlist in the local sandbox

* perf(ai-harness, ai-sandbox): size caps for webfetch and read_file, range reads in the sandbox, one grep listing, and coding events for jobs, snapshots, and the formatter

* docs(ai-harness, ai-sandbox, ai-sandbox-local-process): run the coding tools for many threads, with workspaces per thread, jobs, moving threads between hosts, and snapshots in the log

* feat(ai-harness): ownership.hostId pins threads that use a local folder to their host, with E2E specs for env, roots, moving a sandbox thread, stranded, and pinning

* chore(ai-harness): allow the ps binary in knip, and give polled checks room for slower CI coverage runs

* feat(ai, ai-harness): protocol v2 with one wire encoding, healthy streams, run tags, lifecycle events, usage by source, and tracing (#1821)

* feat(ai-harness, ai): protocol v2 frames with error codes and request ids, observability types, and pull-based SSE and socket senders

* docs(ai-harness): first draft of the harness protocol page

* feat(ai-harness): one wire encoding on every transport with hello, version, request ids, and heartbeats; hooks and status from other hosts; a gap event for evicted feeds

* test(e2e): the access spec skips the hello frame of the session stream

* feat(ai-harness): a grouped stream option for the heartbeat, the slow-consumer close, and the SSE and socket buffer limits

* feat(ai-harness): run tags on every event frame, ctx.model.chat for plugins, and usage by source

* feat(ai-harness): lifecycle events, counted router and transfer model calls, tracing with span links, and onOperation reports

* docs(ai-harness): the harness protocol page, keeping the stream open, stopping a turn from useChat, and the changesets for reporting and observability

* docs(ai-harness): run tags and the gap reload in the custom UI page

* test(e2e): the wire, the gap, the run tree in one stream, lifecycle events, tracing, remote status, cancel from another host, and an unsupported version

* test(ai-harness): give polled checks room for slower CI coverage runs

* feat(ai-mcp, ai-acp, ai-code-mode, ai-skills, ai-harness-cli, ai-harness): integrations on the new harness, with MCP reconnects, ACP order, a skills watcher per host, and a CLI that cancels at once (#1822)

* feat(ai-mcp): mcp() reconnects with backoff, lists tools again on list_changed, and takes needsApproval and toolName per server

* fix(ai-acp, ai-code-mode, ai-harness): ACP keeps prompt order and releases idle sessions, code mode never moves approval tools, harnessText acts for the caller

* perf(ai-skills): one folder watcher per host with a cache of the skills

* feat(ai-harness-cli): cancel and steer act at once in a terminal, loadOptional reports real errors, and --dashboard goes away

* chore(changeset): the integration changes for mcp, acp, code mode, skills, and harnessText

* perf(ai-harness, ai-harness-cli): cheaper plugin, log, media, view, client, and host-event paths, no idle store calls, and context prompts after the history (#1823)

* perf(ai-harness): cache plugin lists and permission patterns, read instruction files async, parse SSE as a stream with one abort listener and capped backoff, and give each control input an id

* perf(ai-harness): stream media, cache base64 parts across turns, cap open-ended ranges, and add a byte-capped event ring

* perf(ai-harness, ai-harness-cli): the view and the printer only redo what changed, children load on demand with view.loadAgent, operation.stream reads from its start

* perf(ai-harness): ring buffer log tail, joins and rebuilt operations read from the run start, a per-tenant host event bus, no MESSAGES_SNAPSHOT in the log, and no idle store calls

* perf(ai-harness): plugin prompts with placement 'context' go after the history, so the cached prompt prefix stays valid

* test(ai-harness): one threadId in the expected gap frame

* test(e2e): the first-party fixtures match the context prompt that now comes after the user message

* fix(ai, ai-harness): a guard tier for tool calls, complete plugin removal, media and body limits, signing keys, and turn and config fixes (#1824)

* fix(ai-harness): a settled operation keeps its status, a media signer with key rotation, and agents() rule docs that match the code

* fix(ai-harness): every plugin contribution has an owner, ctx.on cleans up, inline media goes to the media store, and capabilities report the socket only when mounted

* docs(ai-harness): say when capabilities report the WebSocket

* feat(ai): onGuardToolCall middleware hook that runs on the final arguments of every tool call

* test(e2e): onGuardToolCall denies on the final args after a transformArgs

* fix(ai-harness): tool turns take no steers, a turn keeps its config, removing a plugin removes all of it, body and frame limits, signing keys, and a warning on tool name clashes

* fix(ai-harness): the media signer's key check covers an empty secret

* fix(ai-harness-cli): serve signs media URLs with a key derived from the token, so a short token meets the 32-byte key rule

* feat(ai-harness, ai-mcp, ai-acp, ai-code-mode, ai-harness-cli): the final review of the harness, with its fixes, one object per call, and the known limits (#1825)

* fix(ai-harness, ai-mcp, ai-acp, ai-code-mode): final review fixes for durability, access, plugins, transports, integrations, and coding tools

* fix(ai-acp): one agent app serves one connection, with editor capabilities read from that connection, and no private SDK field

* fix(ai-harness): a thread delete ends it in first-party plugins, the bash spill is scrubbed, removed schedules go at once, agent run receipts resolve, and session.append takes one object with an optional inputId

* refactor(ai-harness, ai-mcp, ai-harness-cli): session, client, and view methods take one object, the client and view use putMedia and client.sessions, and internal fields leave the public types

* docs(ai-harness, ai-mcp, ai-acp, ai-code-mode): the final review changes, the fixed durable-tools and server-tools text, and a known limits section

* fix(ai-harness): revoke and unshare reject when work does not stop, thread delete reaches child logs and known harnesses, plugins declare kept records, and the review fixes

- host.revoke and host.sessions.unshare reject when the work stop fails
  (the access is gone already). unshare ends the reads before it stops
  the work.
- createHarnessHost takes harnesses, so a delete on a new host ends the
  thread in its plugins. An unknown harness warns. A child thread ends in
  the log of its root.
- A plugin declares keepRecords. The core fold reads them from the
  plugins of the harness that folds the log, and counts per type.
  snapshots() keeps its 500 steps this way.
- revert and unrevert open the workspace of the thread from the log when
  no turn opened it on this host.
- The harness.revert and harness.job records keep the principal.
- append with no inputId goes through accept(), so its id is real.
- A formatter config below the root, or a write under node_modules, asks
  again.
- The base64 cache takes the largest encodedBytes. The client takes
  idleTimeoutMs.
- An events() read listens for a revoke from the call, not the first pull.

* docs(ai-harness): the harnesses option, keepRecords, idleTimeoutMs, a revoke that rejects, and one known limit less

* feat(ai-harness): ctx.session.keptRecords reads the kept records of a plugin, and session.revert reads them the same way

* fix(ai-harness): an always answer saves no rule for an @unsaved: action

* refactor(ai-harness): mounted plugins keep each contribution list with its owner, not in parallel owner arrays

* fix(ai-harness): a plugins remove setting is rejected when a kept turn plugin or a harness middleware needs the removed capability

* fix(ai-harness): client media checks every part before it stores any, refuses provider file handles unless media.allowProviderFiles, and the frame limit docs name the server maxPayload

* fix(ai-harness): a retried client input with inline media reuses the stored media, so it stores nothing again and is a duplicate, not a conflict

* docs(ai-harness): routed root-agent turns take steers and late joins, only session.tool() turns do not

* fix(ai-harness-cli): --serve signs media URLs with --media-key or HARNESS_MEDIA_KEY, or a random key, never with the bearer token

* fix(ai-harness): keep the usage source in the view, and a host events read that listens from the call

* fix(ai-harness): send context prompts as the last system prompt, not as a user message

* fix(ai-harness): check the snapshot shape in client.events(), and document its head-first default

* feat(ai-harness): an onTurnStart plugin hook, used by projectInstructions and workspaceTools

* fix(ai-harness): keep the interrupt messages snapshot in the log, so a rejoin from the log gets it

* fix(ai-harness-cli): load the saved child agents in the TUI example, and document view.loadAgent for a ui

* fix(ai-mcp): no reconnect timer after close, backoff that survives crash loops, and onDuplicateTool 'error'

* fix(ai-harness-cli): tell a missing optional package by its resolve error code, not the message text

* fix(ai-harness): check the inner session of harnessText through the outer thread, and pass the run principal on as is

* fix(ai-harness): bind the harnessText inner thread to its outer thread before the outer check applies

* fix(ai-acp): keep the sessions of the connection known on a host with no session index

* refactor(ai-skills): one shared watcher per host that only triggers a sync, with no skill cache

* fix(ai-harness): one harnessText inner thread id shape, <outer>/inner/<harness>, on every host

* fix(ai-harness): use the real OpenTelemetry types, guard a tracer that throws, and trace a transfer inside it

@opentelemetry/api is now an optional peer (type imports, and a lazy load for
trace.setSpan when a host has a tracer). The copied span types and the private
context key are gone. A tracer or span call that throws is logged and fails no
run. The harness.transfer span is part of host.transfer, not a patch after it.

* fix(ai-harness): trim the protocol to one version check, put the parent run on RUN_STARTED, and surface harness.error in the client

- A requested version other than 2 gets unsupported_version from one
  equality check. negotiateVersion, SUPPORTED_PROTOCOL_VERSIONS, and the
  supported field are gone.
- harness.event frames and session events no longer carry parentRunId. The
  AG-UI RUN_STARTED of a child agent run has it.
- client.events() and client.hostEvents() connect again after slow_consumer
  and throw a HarnessProtocolError (code + message) for any other error frame.

* fix(ai-harness): no usage event after a run finished, and bySource on old snapshots

- A ctx.model.chat call that ends after its run settled (the title plugin)
  writes the usage record only: the run sends nothing after RUN_FINISHED.
- Usage totals from a snapshot written before bySource get an empty map at
  load, so session.usage().bySource is always an object.

* fix(ai-harness, ai-persistence): read takeover and open questions from real state, and clear the runs of a stopped owner

- LogStore.acquire returns expired: true when it takes a log from another
  owner whose ownership expired with no release. harness.ownership.changed
  says taken_over from that, not from pending inputs.
- The host status reads open questions from the folded log only.
- The status rule drops the running operations of a stopped owner on
  taken_over, and the old operation of a resumed input, so a reader host
  does not show running forever after a takeover.

* test(ai-harness): an append is an input, so a non-owner forwards it and the log has its input records

- shared-log: check that the two app records land in one store append, or
  neither, among the input records that the append now writes.
- ownership: the append of a host that does not own the log is queued and
  the owner writes it. A write that is not an input (a schedule) is still
  refused.
- docs: an append on a host that does not own the thread gets a queued
  receipt.

* fix(ai-harness): coding tools review fixes for many threads

- The changed-since-read check keeps what each chat run read, so a lead
  and its tool-mode subagents do not lose each other's edits.
- File locks are keyed by the sandbox (or host) and the real path, not by
  the root string.
- A foreground command moves to the background only under maxJobs, and
  the log gets its process id (exec onStart), so a later host can stop it.
- A job that the backend cannot check (killJob throws, or no killJob)
  stays in the log, and the model hears that it may still run.
  hostBackend.killJob throws when ps gives no start time.
- workspaceRoot(base, ...parts) encodes each part of a workspace folder,
  so a thread id from a client cannot leave base.
- host.unpin({ harness, threadId }) unpins a thread from a host that does
  not come back.

* fix(ai-sandbox, ai-sandbox-local-process): job ids with a start time, one commandEnv, and passEnv

- sandboxWorkspaceBackend gives a job id of pid and start time (ps -o
  lstart), and killJob stops only the process that started then. It
  rejects when it cannot check a process that runs.
- commandEnv and createOutputTail live in @tanstack/ai-sandbox, and
  local-process imports commandEnv from there.
- localProcessSandbox({ passEnv }) gives commands more variables of the
  host, for a CLI login or a proxy.

* docs(ai-harness, ai-sandbox): safe workspace roots, host.unpin, a stable hostId, no isolation claims for host commands, and passEnv

* refactor(ai-utils, ai-harness, ai-sandbox, ai-sandbox-local-process): one commandEnv and createOutputTail in @tanstack/ai-utils

The three packages import both helpers from @tanstack/ai-utils, a new
direct dependency of each. No more copies. commandEnv reads process.env
only when there is a process, and createOutputTail needs no Buffer.

* feat(ai-persistence, ai-harness): host heartbeats, so a pin lapses only when its host stopped

- LogStore.heartbeat({ hostId, ttlMs }). acquire and listOrphaned ignore
  the affinity of a host with no live heartbeat. The memory store, the
  conformance suite, and the SQL recipe have it.
- A host with ownership.hostId sends a heartbeat each renewMs, also when
  it owns no log. A live host keeps its pins on idle threads. When it
  stops, another host reattaches its threads.
- Docs for the workspaces, deploy, durable sessions, and store pages.

* fix(ai-utils): type the process env of commandEnv, so the React Native smoke typechecks

Without process, commandEnv reads {}. The union of process.env and {}
cannot be indexed by a string under the React Native smoke tsconfig
(TS7053 at command.ts:46), and the Test job stopped there.

* fix(ai-vertex): give ai-vertex the same @google/genai copy as ai-gemini again

The lockfile moved the @google/genai devDependency of ai-vertex to the
zod@4.6.5 peer copy, while ai-gemini keeps the zod@4.3.6 copy. Then the
vi.mock('@google/genai') of the vertex tests mocks another file than the
one that ai-gemini imports, and tests/factories.test.ts fails.

* test(ai-harness): give the live-host pin test a 1 s heartbeat

With a 300 ms ttl and a 100 ms heartbeat, a CI run that holds the event
loop for 200 ms lets the heartbeat expire, and the pin stops counting.
AlemTuzlak added a commit that referenced this pull request Oct 19, 2026
… agent in the log, and host.transfer between harnesses (#1819)

* wip(ai-harness): PR 9 transfer (stopped mid-way, not checked)

* feat(ai-harness): host.transfer moves a conversation to another harness with an envelope, links both threads, and is safe to retry; fork stays in its harness

* feat(ai-harness): the active agent lives in the log and answers when the router picks nothing; routing.strategy 'handoff' becomes routing.after 'main'

* feat(ai-harness): ctx.harness.handoff, a handoff tool, and one handoff path for code, tool, and router, with the target answering in the same turn

* feat(ai-harness): hand a turn to a person through a human wait, operator replies with as: 'operator', and run.handoff for the main model's tools

* feat(ai-harness): handing a turn to a person is opt-in with routing.humans, and an operator reply shows live in the view

* test(e2e): handoffs to an agent and to a person, and a transfer between harnesses that is safe to retry

* docs(ai-harness): hand off a conversation to an agent, to a person, or to another harness

* test(e2e): the handoff route reads view text by message role

* feat(ai-harness, ai-sandbox, ai-sandbox-local-process): coding tools for many threads, with workspaces per run, locks, bounded jobs, and moving threads between hosts (#1820)

* fix(ai-harness, ai-sandbox): coding commands get an env allowlist, one workspace per thread, and real paths checked under the lock

* wip: unfinished node work, saved before a shutdown (not reviewed)

* fix(ai-harness): shared file locks with an unchanged check, and snapshots per thread and per run

* fix(ai-harness, ai-sandbox, ai-sandbox-local-process): bounded background jobs with a ring buffer, a kill that waits for the spawn, workspace close, and an env allowlist in the local sandbox

* perf(ai-harness, ai-sandbox): size caps for webfetch and read_file, range reads in the sandbox, one grep listing, and coding events for jobs, snapshots, and the formatter

* docs(ai-harness, ai-sandbox, ai-sandbox-local-process): run the coding tools for many threads, with workspaces per thread, jobs, moving threads between hosts, and snapshots in the log

* feat(ai-harness): ownership.hostId pins threads that use a local folder to their host, with E2E specs for env, roots, moving a sandbox thread, stranded, and pinning

* chore(ai-harness): allow the ps binary in knip, and give polled checks room for slower CI coverage runs

* feat(ai, ai-harness): protocol v2 with one wire encoding, healthy streams, run tags, lifecycle events, usage by source, and tracing (#1821)

* feat(ai-harness, ai): protocol v2 frames with error codes and request ids, observability types, and pull-based SSE and socket senders

* docs(ai-harness): first draft of the harness protocol page

* feat(ai-harness): one wire encoding on every transport with hello, version, request ids, and heartbeats; hooks and status from other hosts; a gap event for evicted feeds

* test(e2e): the access spec skips the hello frame of the session stream

* feat(ai-harness): a grouped stream option for the heartbeat, the slow-consumer close, and the SSE and socket buffer limits

* feat(ai-harness): run tags on every event frame, ctx.model.chat for plugins, and usage by source

* feat(ai-harness): lifecycle events, counted router and transfer model calls, tracing with span links, and onOperation reports

* docs(ai-harness): the harness protocol page, keeping the stream open, stopping a turn from useChat, and the changesets for reporting and observability

* docs(ai-harness): run tags and the gap reload in the custom UI page

* test(e2e): the wire, the gap, the run tree in one stream, lifecycle events, tracing, remote status, cancel from another host, and an unsupported version

* test(ai-harness): give polled checks room for slower CI coverage runs

* feat(ai-mcp, ai-acp, ai-code-mode, ai-skills, ai-harness-cli, ai-harness): integrations on the new harness, with MCP reconnects, ACP order, a skills watcher per host, and a CLI that cancels at once (#1822)

* feat(ai-mcp): mcp() reconnects with backoff, lists tools again on list_changed, and takes needsApproval and toolName per server

* fix(ai-acp, ai-code-mode, ai-harness): ACP keeps prompt order and releases idle sessions, code mode never moves approval tools, harnessText acts for the caller

* perf(ai-skills): one folder watcher per host with a cache of the skills

* feat(ai-harness-cli): cancel and steer act at once in a terminal, loadOptional reports real errors, and --dashboard goes away

* chore(changeset): the integration changes for mcp, acp, code mode, skills, and harnessText

* perf(ai-harness, ai-harness-cli): cheaper plugin, log, media, view, client, and host-event paths, no idle store calls, and context prompts after the history (#1823)

* perf(ai-harness): cache plugin lists and permission patterns, read instruction files async, parse SSE as a stream with one abort listener and capped backoff, and give each control input an id

* perf(ai-harness): stream media, cache base64 parts across turns, cap open-ended ranges, and add a byte-capped event ring

* perf(ai-harness, ai-harness-cli): the view and the printer only redo what changed, children load on demand with view.loadAgent, operation.stream reads from its start

* perf(ai-harness): ring buffer log tail, joins and rebuilt operations read from the run start, a per-tenant host event bus, no MESSAGES_SNAPSHOT in the log, and no idle store calls

* perf(ai-harness): plugin prompts with placement 'context' go after the history, so the cached prompt prefix stays valid

* test(ai-harness): one threadId in the expected gap frame

* test(e2e): the first-party fixtures match the context prompt that now comes after the user message

* fix(ai, ai-harness): a guard tier for tool calls, complete plugin removal, media and body limits, signing keys, and turn and config fixes (#1824)

* fix(ai-harness): a settled operation keeps its status, a media signer with key rotation, and agents() rule docs that match the code

* fix(ai-harness): every plugin contribution has an owner, ctx.on cleans up, inline media goes to the media store, and capabilities report the socket only when mounted

* docs(ai-harness): say when capabilities report the WebSocket

* feat(ai): onGuardToolCall middleware hook that runs on the final arguments of every tool call

* test(e2e): onGuardToolCall denies on the final args after a transformArgs

* fix(ai-harness): tool turns take no steers, a turn keeps its config, removing a plugin removes all of it, body and frame limits, signing keys, and a warning on tool name clashes

* fix(ai-harness): the media signer's key check covers an empty secret

* fix(ai-harness-cli): serve signs media URLs with a key derived from the token, so a short token meets the 32-byte key rule

* feat(ai-harness, ai-mcp, ai-acp, ai-code-mode, ai-harness-cli): the final review of the harness, with its fixes, one object per call, and the known limits (#1825)

* fix(ai-harness, ai-mcp, ai-acp, ai-code-mode): final review fixes for durability, access, plugins, transports, integrations, and coding tools

* fix(ai-acp): one agent app serves one connection, with editor capabilities read from that connection, and no private SDK field

* fix(ai-harness): a thread delete ends it in first-party plugins, the bash spill is scrubbed, removed schedules go at once, agent run receipts resolve, and session.append takes one object with an optional inputId

* refactor(ai-harness, ai-mcp, ai-harness-cli): session, client, and view methods take one object, the client and view use putMedia and client.sessions, and internal fields leave the public types

* docs(ai-harness, ai-mcp, ai-acp, ai-code-mode): the final review changes, the fixed durable-tools and server-tools text, and a known limits section

* fix(ai-harness): revoke and unshare reject when work does not stop, thread delete reaches child logs and known harnesses, plugins declare kept records, and the review fixes

- host.revoke and host.sessions.unshare reject when the work stop fails
  (the access is gone already). unshare ends the reads before it stops
  the work.
- createHarnessHost takes harnesses, so a delete on a new host ends the
  thread in its plugins. An unknown harness warns. A child thread ends in
  the log of its root.
- A plugin declares keepRecords. The core fold reads them from the
  plugins of the harness that folds the log, and counts per type.
  snapshots() keeps its 500 steps this way.
- revert and unrevert open the workspace of the thread from the log when
  no turn opened it on this host.
- The harness.revert and harness.job records keep the principal.
- append with no inputId goes through accept(), so its id is real.
- A formatter config below the root, or a write under node_modules, asks
  again.
- The base64 cache takes the largest encodedBytes. The client takes
  idleTimeoutMs.
- An events() read listens for a revoke from the call, not the first pull.

* docs(ai-harness): the harnesses option, keepRecords, idleTimeoutMs, a revoke that rejects, and one known limit less

* feat(ai-harness): ctx.session.keptRecords reads the kept records of a plugin, and session.revert reads them the same way

* fix(ai-harness): an always answer saves no rule for an @unsaved: action

* refactor(ai-harness): mounted plugins keep each contribution list with its owner, not in parallel owner arrays

* fix(ai-harness): a plugins remove setting is rejected when a kept turn plugin or a harness middleware needs the removed capability

* fix(ai-harness): client media checks every part before it stores any, refuses provider file handles unless media.allowProviderFiles, and the frame limit docs name the server maxPayload

* fix(ai-harness): a retried client input with inline media reuses the stored media, so it stores nothing again and is a duplicate, not a conflict

* docs(ai-harness): routed root-agent turns take steers and late joins, only session.tool() turns do not

* fix(ai-harness-cli): --serve signs media URLs with --media-key or HARNESS_MEDIA_KEY, or a random key, never with the bearer token

* fix(ai-harness): keep the usage source in the view, and a host events read that listens from the call

* fix(ai-harness): send context prompts as the last system prompt, not as a user message

* fix(ai-harness): check the snapshot shape in client.events(), and document its head-first default

* feat(ai-harness): an onTurnStart plugin hook, used by projectInstructions and workspaceTools

* fix(ai-harness): keep the interrupt messages snapshot in the log, so a rejoin from the log gets it

* fix(ai-harness-cli): load the saved child agents in the TUI example, and document view.loadAgent for a ui

* fix(ai-mcp): no reconnect timer after close, backoff that survives crash loops, and onDuplicateTool 'error'

* fix(ai-harness-cli): tell a missing optional package by its resolve error code, not the message text

* fix(ai-harness): check the inner session of harnessText through the outer thread, and pass the run principal on as is

* fix(ai-harness): bind the harnessText inner thread to its outer thread before the outer check applies

* fix(ai-acp): keep the sessions of the connection known on a host with no session index

* refactor(ai-skills): one shared watcher per host that only triggers a sync, with no skill cache

* fix(ai-harness): one harnessText inner thread id shape, <outer>/inner/<harness>, on every host

* fix(ai-harness): use the real OpenTelemetry types, guard a tracer that throws, and trace a transfer inside it

@opentelemetry/api is now an optional peer (type imports, and a lazy load for
trace.setSpan when a host has a tracer). The copied span types and the private
context key are gone. A tracer or span call that throws is logged and fails no
run. The harness.transfer span is part of host.transfer, not a patch after it.

* fix(ai-harness): trim the protocol to one version check, put the parent run on RUN_STARTED, and surface harness.error in the client

- A requested version other than 2 gets unsupported_version from one
  equality check. negotiateVersion, SUPPORTED_PROTOCOL_VERSIONS, and the
  supported field are gone.
- harness.event frames and session events no longer carry parentRunId. The
  AG-UI RUN_STARTED of a child agent run has it.
- client.events() and client.hostEvents() connect again after slow_consumer
  and throw a HarnessProtocolError (code + message) for any other error frame.

* fix(ai-harness): no usage event after a run finished, and bySource on old snapshots

- A ctx.model.chat call that ends after its run settled (the title plugin)
  writes the usage record only: the run sends nothing after RUN_FINISHED.
- Usage totals from a snapshot written before bySource get an empty map at
  load, so session.usage().bySource is always an object.

* fix(ai-harness, ai-persistence): read takeover and open questions from real state, and clear the runs of a stopped owner

- LogStore.acquire returns expired: true when it takes a log from another
  owner whose ownership expired with no release. harness.ownership.changed
  says taken_over from that, not from pending inputs.
- The host status reads open questions from the folded log only.
- The status rule drops the running operations of a stopped owner on
  taken_over, and the old operation of a resumed input, so a reader host
  does not show running forever after a takeover.

* test(ai-harness): an append is an input, so a non-owner forwards it and the log has its input records

- shared-log: check that the two app records land in one store append, or
  neither, among the input records that the append now writes.
- ownership: the append of a host that does not own the log is queued and
  the owner writes it. A write that is not an input (a schedule) is still
  refused.
- docs: an append on a host that does not own the thread gets a queued
  receipt.

* fix(ai-harness): coding tools review fixes for many threads

- The changed-since-read check keeps what each chat run read, so a lead
  and its tool-mode subagents do not lose each other's edits.
- File locks are keyed by the sandbox (or host) and the real path, not by
  the root string.
- A foreground command moves to the background only under maxJobs, and
  the log gets its process id (exec onStart), so a later host can stop it.
- A job that the backend cannot check (killJob throws, or no killJob)
  stays in the log, and the model hears that it may still run.
  hostBackend.killJob throws when ps gives no start time.
- workspaceRoot(base, ...parts) encodes each part of a workspace folder,
  so a thread id from a client cannot leave base.
- host.unpin({ harness, threadId }) unpins a thread from a host that does
  not come back.

* fix(ai-sandbox, ai-sandbox-local-process): job ids with a start time, one commandEnv, and passEnv

- sandboxWorkspaceBackend gives a job id of pid and start time (ps -o
  lstart), and killJob stops only the process that started then. It
  rejects when it cannot check a process that runs.
- commandEnv and createOutputTail live in @tanstack/ai-sandbox, and
  local-process imports commandEnv from there.
- localProcessSandbox({ passEnv }) gives commands more variables of the
  host, for a CLI login or a proxy.

* docs(ai-harness, ai-sandbox): safe workspace roots, host.unpin, a stable hostId, no isolation claims for host commands, and passEnv

* refactor(ai-utils, ai-harness, ai-sandbox, ai-sandbox-local-process): one commandEnv and createOutputTail in @tanstack/ai-utils

The three packages import both helpers from @tanstack/ai-utils, a new
direct dependency of each. No more copies. commandEnv reads process.env
only when there is a process, and createOutputTail needs no Buffer.

* feat(ai-persistence, ai-harness): host heartbeats, so a pin lapses only when its host stopped

- LogStore.heartbeat({ hostId, ttlMs }). acquire and listOrphaned ignore
  the affinity of a host with no live heartbeat. The memory store, the
  conformance suite, and the SQL recipe have it.
- A host with ownership.hostId sends a heartbeat each renewMs, also when
  it owns no log. A live host keeps its pins on idle threads. When it
  stops, another host reattaches its threads.
- Docs for the workspaces, deploy, durable sessions, and store pages.

* fix(ai-utils): type the process env of commandEnv, so the React Native smoke typechecks

Without process, commandEnv reads {}. The union of process.env and {}
cannot be indexed by a string under the React Native smoke tsconfig
(TS7053 at command.ts:46), and the Test job stopped there.

* fix(ai-vertex): give ai-vertex the same @google/genai copy as ai-gemini again

The lockfile moved the @google/genai devDependency of ai-vertex to the
zod@4.6.5 peer copy, while ai-gemini keeps the zod@4.3.6 copy. Then the
vi.mock('@google/genai') of the vertex tests mocks another file than the
one that ai-gemini imports, and tests/factories.test.ts fails.

* test(ai-harness): give the live-host pin test a 1 s heartbeat

With a 300 ms ttl and a 100 ms heartbeat, a CI run that holds the event
loop for 200 ms lets the heartbeat expire, and the pin stops counting.

* feat(ai-harness, ai-persistence): an operator role, so the user who waits for a person cannot act as that person

membersOnly() gives the operator action only to the role 'operator' by
default. membersOnly({ operator: { roles } }) sets the roles that have it.
A human wait takes only 'operator', for an answer and for a resolve that
ends it, on a handle and through host.submit.

* fix(ai-harness): handoff review fixes

- The fold ends a handoff to a person when its human wait settles in any
  way, and refuses a human handoff record with no waitId.
- The router writes the move to the main model once when the active agent
  is gone.
- An operator can hand back to a root agent of a turn plugin: the human
  handoff record keeps the agents of its turn.
- routing.handoffs: false gives no model the handoff tool.
- A handoff stops only the chat that made it.
- A handoff in a part that also stops for interrupts waits with them, so
  the resolve turn runs the target or pauses for a person.
- The view adds no empty message for a handoff to a person or an operator
  hand-back.
- An operator reply keeps its text in the assistant message and its files
  in a marked user note, which the view shows with the reply.
- host.transfer throws for a source thread that does not exist.

* fix(ai): ask onShouldContinue after the resumed tools, before the next model call

A resume runs the pending tool calls, then went to the model with no loop
check. Now the middleware onShouldContinue decides, as after any tool
phase. false ends the run with no more model calls. So a harness handoff
in a part that also waited for a client tool runs the target in the
resolve turn, and the agent that handed off does not answer again.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

waiting-on: maintainer The ball is in the maintainers’ court

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants