Skip to content

[CK] Add FP8 KV_BLOCKSCALE support for batch prefill#3696

Closed
Jeff-Huang wants to merge 6 commits intodevelopfrom
batch-prefill-fp8-kvcache-blockscale
Closed

[CK] Add FP8 KV_BLOCKSCALE support for batch prefill#3696
Jeff-Huang wants to merge 6 commits intodevelopfrom
batch-prefill-fp8-kvcache-blockscale