Skip to content

fix: stop activation KV cache from growing every turn - #2359

Open
yetuge wants to merge 13 commits into
MemTensor:mainfrom
yetuge:fix/activation-cache-aliasing
Open

fix: stop activation KV cache from growing every turn#2359
yetuge wants to merge 13 commits into
MemTensor:mainfrom
yetuge:fix/activation-cache-aliasing

fix: reset destination cache layers

499705a
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs