Skip to content

perf: vectorize KV cache prefix matching with numpy#2179

Open
nausicaalii wants to merge 2 commits into
abetlen:mainfrom
nausicaalii:perf/vectorize-prefix-match
Open

perf: vectorize KV cache prefix matching with numpy#2179
nausicaalii wants to merge 2 commits into
abetlen:mainfrom
nausicaalii:perf/vectorize-prefix-match

refactor: deduplicate prefix matching and eliminate .tolist() overhead

aeb7d7c
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs