Skip to content

Commit 1464daa

Browse files
committed
fix condition
Signed-off-by: fsx950223 <fsx950223@outlook.com>
1 parent 9a17437 commit 1464daa

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm/v1/attention/backends/triton_attn.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -310,7 +310,8 @@ def forward(
310310
key_cache, value_cache = kv_cache.unbind(1)
311311

312312
if (
313-
self.kv_sharing_target_layer_name is None
313+
self.attn_type == AttentionType.DECODER
314+
and self.kv_sharing_target_layer_name is None
314315
and key is not None
315316
and value is not None
316317
):

0 commit comments

Comments
 (0)