Skip to content

Commit 1c69959

Browse files
committed
update format for rocm_aiter_unified_attn.py
Signed-off-by: apinge <Tong.Qiu2@amd.com>
1 parent 723bf67 commit 1c69959

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

vllm/v1/attention/backends/rocm_aiter_unified_attn.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -176,7 +176,10 @@ def forward(
176176
max_seqlen_k = attn_metadata.max_seq_len
177177
block_table = attn_metadata.block_table
178178

179-
descale_shape = (cu_seqlens_q.shape[0] - 1, key.shape[1] if key is not None else self.num_kv_heads)
179+
descale_shape = (
180+
cu_seqlens_q.shape[0] - 1,
181+
key.shape[1] if key is not None else self.num_kv_heads,
182+
)
180183

181184
self.unified_attention(
182185
q=query[:num_actual_tokens],

0 commit comments

Comments
 (0)