Skip to content

Add Benchmarking Orchestration#275

Open
Max Smythe (maxsmythe) wants to merge 8 commits into
agent-substrate:mainfrom
maxsmythe:headless-benchmarking-phased-commits
Open

Add Benchmarking Orchestration#275
Max Smythe (maxsmythe) wants to merge 8 commits into
agent-substrate:mainfrom
maxsmythe:headless-benchmarking-phased-commits

Conversation

@maxsmythe

Copy link
Copy Markdown
Collaborator

The main thrust of this PR is to add early automated benchmarking Orchestration code.

Apologies for the large PR, I've split it into coherent commits.

  • "fix imports; overwrite RAM buffer; add status metric": is Add baseline glutton #243 (is synced to the current state of that PR, so it's possible to just merge this one)

  • "add http support to glutton" : adds http support to the glutton and documents its proto commands

  • "streamline locust install + fix performance bugs": makes installing locust for ad-hoc tests a one-liner and fixes the fact that Python's gRPC client interferes with greenlets by default, causing deadlocks in the test runner

  • "verify licenses of Python dependencies": figured it would be good to guard against AGPL, etc.

  • "add automated benchmarking Orchestration": creates an orchestrator that lives in its own cluster, running load tests on target clusters (prow-lite until we have more defined infrastructure)

@maxsmythe Max Smythe (maxsmythe) force-pushed the headless-benchmarking-phased-commits branch 16 times, most recently from 2a0b3ac to d0204cf Compare June 23, 2026 03:08
@maxsmythe Max Smythe (maxsmythe) force-pushed the headless-benchmarking-phased-commits branch from d0204cf to 275ff25 Compare June 25, 2026 07:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant