Skip to content

Commit 9aaf36c

Browse files
committed
update code
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
1 parent fff3fcb commit 9aaf36c

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/layers/fused_moe/flashinfer_trtllm_moe.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,7 @@ def flashinfer_fused_moe_blockscale_fp8(
3333
routing_method_type: int = 2,
3434
) -> torch.Tensor:
3535
from vllm.utils.flashinfer import flashinfer_trtllm_fp8_block_scale_moe
36-
36+
topk_group = topk_group if topk_group is not None else 0
3737
assert top_k <= global_num_experts
3838
assert top_k <= 10
3939
# assert topk_group <= 4

0 commit comments

Comments
 (0)