FEAT: Plan-Time Modality Validation and Policy for Scenario Runs - #2773

Open

Victor Valbuena (ValbuenaVC) wants to merge 35 commits into

microsoft:mainfrom

ValbuenaVC:multimodal

Commits on Sep 22, 2026

MAINT: get_mock_target gains real modality capabilities for tests

Victor Valbuena
and
Claude (claude)
committed
cb639c1
MAINT: public scorer modality accessors

Victor Valbuena
and
Claude (claude)
committed
45df307
MAINT: extract project_request_chain from the technique factory

Victor Valbuena
and
Claude (claude)
committed
8563ffe
FEAT: derive modality compatibility for a built atomic attack

Victor Valbuena
and
Claude (claude)
committed
6f42ad5
FEAT: enforce modality compatibility before a scenario runs

Victor Valbuena
and
Claude (claude)
committed
fbeef14
DOC: document scenario modality validation

Victor Valbuena
and
Claude (claude)
committed
06c1963
Merge branch 'main' into multimodal
Victor Valbuena (ValbuenaVC)
authored
5cae189
FIX: keep the modality capability guard under ty 0.0.80

Victor Valbuena
and
Claude (claude)
committed
c79d5fc
MAINT: read target input modalities literally in modality validation

Victor Valbuena
and
Claude (claude)
committed
f99617a
Merge branch 'main' into multimodal
Victor Valbuena (ValbuenaVC)
authored
c6c07bc
Merge branch 'main' into multimodal
Victor Valbuena (ValbuenaVC)
authored
2791646

Commits on Sep 23, 2026

Fix indexed request modality projection
Victor Valbuena
committed
0e9aa2d
Validate only replayed seed groups on scenario resume
Victor Valbuena
committed
ea6a2d2
Merge fork multimodal branch updates
Victor Valbuena
committed
99ba328
Match composite modality declarations to applicable scorers
Victor Valbuena
committed
96aed67
Merge branch 'main' into multimodal
Victor Valbuena (ValbuenaVC)
authored
85b9e07
Honor selective scoring when validating target responses
Victor Valbuena
committed
1c14fad
Validate converted responses and avoid false wrapper requests
Victor Valbuena
committed
d2cea7e
Track reviewer fixes and remaining validation limits
Victor Valbuena
committed
dd55b2e
Merge branch 'main' into multimodal
Victor Valbuena (ValbuenaVC)
authored
2c61f96
Merge branch 'main' into multimodal
Victor Valbuena (ValbuenaVC)
authored
aa97f5a
Account for TAP generated first roots in modality plans
Victor Valbuena
committed
6ce547d
Merge fork multimodal branch updates
Victor Valbuena
committed
b062c7d
Merge branch 'main' into multimodal
Victor Valbuena (ValbuenaVC)
authored
333ea9b
Merge branch 'main' into multimodal
Victor Valbuena (ValbuenaVC)
authored
2b8a788

Commits on Sep 24, 2026

Merge branch 'main' into multimodal
Victor Valbuena (ValbuenaVC)
authored
3e944e6
Remove local reviewer tracker from PR
Victor Valbuena
committed
a9c0c4b
Merge branch 'main' into multimodal
Victor Valbuena (ValbuenaVC)
authored
ff020e2
Validate effective next-message overrides in scenario plans
Victor Valbuena
committed
36648c6
Merge branch 'main' into multimodal
Victor Valbuena (ValbuenaVC)
authored
bec5521
Fix mixed-response compatibility for raise-on-empty scorers
Victor Valbuena
committed
64b7d25
Merge main scorer refactor with conservative modality declarations
Victor Valbuena
committed
6326076
Preserve alternative converter outputs during modality projection
Victor Valbuena
committed
617beaa
Merge branch 'main' into multimodal
Victor Valbuena (ValbuenaVC)
authored
4d7a014
Merge branch 'main' into multimodal
Victor Valbuena (ValbuenaVC)
authored
2a2acce