feat(runtime): structuralRollout strategy + rollout-policy improve surface (measured +8..+21pp) by drewstone · Pull Request #503 · tangle-network/agent-runtime

feat(bench): honest-oracle structural-lever rig for HumanEval (best-of-k + self-repair on docstring examples)

drewstone

committed

feat(bench): CodeT-style generated-assert oracle (TESTGEN) for the structural-lever rig

drewstone

committed

feat(bench): DIVERSE mode — per-slot strategy prefixes to attack the all-k-samples-fail bucket

drewstone

committed

feat(bench): MBPP structural-lever rig — visible=shown assert (+TESTGEN), hidden=remaining asserts

drewstone

committed

docs(design): structural-rollout integration map — CheckSource is the only net-new seam; extend strategy family, verifier-environment, field routing

drewstone

committed

feat(runtime): structuralRollout strategy — k-sample + visible-check select + guarded repair (measured +8..+21pp)

drewstone

committed

chore(bench): track the prompt-evolution rigs behind the documented null result (hev-eval, hev-improve)

drewstone

committed

feat(improvement): rollout-policy surface — improve() tunes structuralRollout dials under the held-out gate

drewstone

committed

fix(runtime): carry the stopping content-only assistant reply in the tool-loop conversation

drewstone

committed

fix(runtime): fuse instruction+task into one user message for trajectory-less consults

drewstone

committed

feat(bench): structuralRollout runtime smoke — real model, real HumanEval, hidden grading script-side

drewstone

committed

docs(api): regenerate API reference for structuralRollout + rollout-policy exports

drewstone

committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat(runtime): structuralRollout strategy + rollout-policy improve surface (measured +8..+21pp)#503

feat(runtime): structuralRollout strategy + rollout-policy improve surface (measured +8..+21pp)#503
drewstone merged 12 commits into
mainfrom
feat/structural-rollout

Commits on Jul 9, 2026

feat(bench): honest-oracle structural-lever rig for HumanEval (best-of-k + self-repair on docstring examples)

feat(bench): CodeT-style generated-assert oracle (TESTGEN) for the structural-lever rig

feat(bench): DIVERSE mode — per-slot strategy prefixes to attack the all-k-samples-fail bucket

feat(bench): MBPP structural-lever rig — visible=shown assert (+TESTGEN), hidden=remaining asserts

docs(design): structural-rollout integration map — CheckSource is the only net-new seam; extend strategy family, verifier-environment, field routing

feat(runtime): structuralRollout strategy — k-sample + visible-check select + guarded repair (measured +8..+21pp)

chore(bench): track the prompt-evolution rigs behind the documented null result (hev-eval, hev-improve)

feat(improvement): rollout-policy surface — improve() tunes structuralRollout dials under the held-out gate

fix(runtime): carry the stopping content-only assistant reply in the tool-loop conversation

fix(runtime): fuse instruction+task into one user message for trajectory-less consults

feat(bench): structuralRollout runtime smoke — real model, real HumanEval, hidden grading script-side

docs(api): regenerate API reference for structuralRollout + rollout-policy exports