Skip to content

Commit 9a17437

Browse files
committed
change api
Signed-off-by: fsx950223 <fsx950223@outlook.com>
1 parent a5bd54a commit 9a17437

File tree

1 file changed

+1
-5
lines changed

1 file changed

+1
-5
lines changed

vllm/v1/worker/utils.py

Lines changed: 1 addition & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -316,11 +316,7 @@ def bind_kv_cache(
316316
# TODO - analyze where runner_kv_caches is used and the right
317317
# way to ensure it properly reflects multiple attention layers
318318
# in the same decoder block.
319-
if (
320-
current_platform.is_cuda()
321-
or current_platform.is_xpu()
322-
or current_platform.is_rocm()
323-
):
319+
if current_platform.is_cuda_alike() or current_platform.is_xpu():
324320
# We know that the GPU runner is not impacted by this
325321
# case. Some test code depends on runner_kv_caches, but
326322
# not in a way that's impacted by ignoring this.

0 commit comments

Comments
 (0)