-
Notifications
You must be signed in to change notification settings - Fork 30
Pull requests: GoogleCloudPlatform/evalbench
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
authenticate from ADC, drop host OAuth token mirroring
#549
opened Aug 5, 2026 by
omkargaikwad23
Collaborator
Loading…
2 tasks done
Fix no data bug / Replace hardcoded requester filter with dropdown
#545
opened Aug 4, 2026 by
ikenwan-dev
Loading…
Fix 5-tuple unpacking error in EvalServicer.Interact()
#540
opened Jul 31, 2026 by
saurabh-net
Collaborator
Loading…
feat(evalbench): add native Agent Runtime generator support and deployment guide
#535
opened Jul 28, 2026 by
arieljassan
Member
Loading…
feat(scorers): add NamedScorer wrapper to support custom scorer names
#533
opened Jul 28, 2026 by
nmath-goog
Contributor
Loading…
chore(main): release 1.15.0
autorelease: pending
#530
opened Jul 28, 2026 by
release-please
Bot
Loading…
feat(scorers): support multiple python_scorer_* entries in run YAML
#528
opened Jul 27, 2026 by
saurabh-net
Collaborator
Loading…
[WIP] fix(dea): support local boq evaluation via stubby
#525
opened Jul 24, 2026 by
minzznguyen
Contributor
Loading…
Fix cache-corrupted token metrics in multi-turn Claude Code eval
#509
opened Jul 21, 2026 by
prernakakkar-google
Collaborator
Loading…
feat(scorers): add non_final_output_tokens metric robust to answer-verbosity variance
#495
opened Jul 15, 2026 by
prernakakkar-google
Collaborator
Loading…
Add support for per-prompt execution timeout (prompt_timeout_seconds)
#493
opened Jul 14, 2026 by
graceqi-g
Collaborator
Loading…
Add field to track time to first response and token usages
#492
opened Jul 13, 2026 by
totoleon
Collaborator
Loading…
feat: Improve isolation of agent evaluation CUJs by staging the work_dir to a new tmp directory tree
#462
opened Jun 26, 2026 by
g-lynnzee
Contributor
Loading…
fix: make PYTHONPATH robust across different working directories
#307
opened Apr 6, 2026 by
aseering
Contributor
Loading…
ProTip!
Updated in the last three days: updated:>2026-08-02.