Skip to content

fix: prevent KV cache corruption on SWA/ISWA models + hot-path perf#2180

Open
avion23 wants to merge 1 commit into
abetlen:mainfrom
avion23:fix/perf-and-iswa
Open

fix: prevent KV cache corruption on SWA/ISWA models + hot-path perf#2180
avion23 wants to merge 1 commit into
abetlen:mainfrom
avion23:fix/perf-and-iswa

perf: vectorize hot-path ops, reduce Python overhead, fix SWA/ISWA KV…

e54fe59
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs