fix: stop activation KV cache from growing every turn - #2359

Open

yetuge wants to merge 13 commits into

MemTensor:mainfrom

yetuge:fix/activation-cache-aliasing

Commits on Sep 11, 2026

fix: stop activation KV cache from growing every turn (#2301)
yetuge
committed
bf0ddb0
test: harden KV cache clone tests per code review
yetuge
committed
2808420
test: address second review round on cache clone
yetuge
committed
04e3cc4

Commits on Sep 14, 2026

style: format activation cache files
yetuge
committed
d5649e6
fix: align dynamic cache cloning variants
yetuge
committed
873782a
fix: address updated cache clone review findings
yetuge
committed
aae1cbb
fix: isolate dynamic cache clone metadata
yetuge
committed
dac93a1
fix: validate dynamic cache clone invariants
yetuge
committed
507de42
fix: clone modern dynamic cache layers
yetuge
committed
93ec8b1
test: harden cache compatibility regressions
yetuge
committed
c1bd4a5

Commits on Sep 15, 2026

fix: avoid duplicate cache tensor cloning
yetuge
committed
39ecbea
fix: guard hybrid cache helper updates
yetuge
committed
ddf7ad1
fix: reset destination cache layers
yetuge
committed
499705a