Skip to content

Commit c8e08f0

Browse files
committed
[Bugfix] Fix the bug of cos invalid shape when dp
Signed-off-by: weiguihua2 <weiguihua2@huawei.com>
1 parent 8151a9d commit c8e08f0

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

vllm_ascend/torchair/torchair_model_runner.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -419,3 +419,7 @@ def check_torchair_graph_batch_sizes(self):
419419

420420
def _build_drafter_prepare_inputs_torchair_param(self):
421421
return True
422+
423+
def get_dp_padding(self, num_tokens):
424+
"""Override from NPUModelRunner to get dp padding"""
425+
return 0, None

0 commit comments

Comments
 (0)