Skip to content

Commit 8bee3d7

Browse files
committed
fix ds
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
1 parent 252ddb2 commit 8bee3d7

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm_ascend/worker/model_runner_v1.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2436,6 +2436,7 @@ def align_memory(tensor: torch.Tensor, alignment: int) -> torch.Tensor:
24362436
for layer_name in kv_cache_group.layer_names:
24372437
if layer_name in self.runner_only_attn_layers:
24382438
continue
2439+
num_blocks = None
24392440
if not self.model_config.is_deepseek_mla:
24402441
raw_tensor = kv_cache_raw_tensors[layer_name]
24412442
assert raw_tensor.numel(

0 commit comments

Comments
 (0)