Skip to content

feat(asap-tools): long and x5 random-workload variants, pin VictoriaMetrics - #903

Merged
milindsrivastava1997 merged 3 commits into
mainfrom
codex/random-e2e-variants
Oct 15, 2026
Merged

milindsrivastava1997 merged 3 commits into
mainfrom
codex/random-e2e-variants

Conversation

@milindsrivastava1997

Copy link
Copy Markdown
Contributor
  • random_workloads.py --variant long|x5 stretches one dimension of a seed's workloads and keeps every random choice, so variant and base results pair query for query:
    • long: lookbacks ×3, max 60 min, with quantiles over 300s;
    • x5: 250 label_0 values per job, so 50,000 series and 500,000 samples/s.
  • Both are frozen for seed 862, with saved plans for all 20 workloads (sketch-bench a3753f2; no RQE dropped). The base manifests are byte-identical.
  • Run configs are written per set: random_workload/seed-862[-variant]/workload-NN/.
  • VictoriaMetrics is pinned to v1.154.0 (was latest).

Tests: python3 -m unittest discover -s tests -p "test_*.py" (200 pass). Includes variant pairing with the base, and that every set's archive matches its manifests and renders its configs.

🤖 Generated with Claude Code

milindsrivastava1997 and others added 3 commits October 15, 2026 01:09
--variant stretches one dimension of a seed's workloads and keeps every
random choice, so variant and base results pair query for query: long
triples every lookback (max 60 min), x5 has 250 label_0 values per job
(50,000 series, 500,000 samples/s). Freezes both for seed 862; the base
manifests are unchanged.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Each of the 20 workloads exported (sketch-bench a3753f2), solved and
converted by --planner saved like the base; none drops an RQE. Run
configs go under their set, random_workload/seed-862[-variant]/, as the
variants share workload ids. Tests cover every set's archive.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
`latest` can change between runs of one experiment; v1.154.0 is what the
random-workload pilot ran.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@milindsrivastava1997
milindsrivastava1997 merged commit 978644e into main Oct 15, 2026
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant