Skip to content

[TRTLLM-12499][perf] Bounded block-ID retrieval for pipelined KV transfer chunks - #17526

Closed
athena-nv wants to merge 3 commits into
NVIDIA:mainfrom
athena-nv:trtllm-12499-pipelined-kvcache-transfer-fetch-slice_opt
Closed

athena-nv wants to merge 3 commits into
NVIDIA:mainfrom
athena-nv:trtllm-12499-pipelined-kvcache-transfer-fetch-slice_opt

Add bounded tail block-ID retrieval for chunked KV transfer

456afe2
Select commit
Loading
Failed to load commit list.