Skip to content

Commit 37c030a

Browse files
committed
fix world size
Signed-off-by: whx-sjtu <2952154980@qq.com>
1 parent fc2bcbe commit 37c030a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_ascend/worker/model_runner_v1.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1539,7 +1539,7 @@ def _select_moe_comm_method(self, num_tokens: int) -> str:
15391539
if not self.parallel_config.enable_expert_parallel:
15401540
moe_comm_method = "allgather"
15411541
elif soc_version in {AscendSocVersion.A2}:
1542-
if num_tokens <= self.mc2_tokens_capacity and self.parallel_config.world_size >= 16:
1542+
if num_tokens <= self.mc2_tokens_capacity and self.parallel_config.world_size_across_dp >= 16:
15431543
moe_comm_method = "mc2"
15441544
else:
15451545
moe_comm_method = "allgather"

0 commit comments

Comments
 (0)