Skip to content

Commit 40ebc47

Browse files
committed
revert MOE_DP_CHUNK_SIZE
Signed-off-by: Bill Nell <bnell@redhat.com>
1 parent c5adb68 commit 40ebc47

File tree

1 file changed

+2
-1
lines changed
  • vllm/model_executor/layers/fused_moe

1 file changed

+2
-1
lines changed

vllm/model_executor/layers/fused_moe/layer.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -56,7 +56,8 @@
5656
logger = init_logger(__name__)
5757

5858
# Note: this limit is somewhat arbitrary and might be changed later.
59-
MOE_DP_CHUNK_SIZE = envs.VLLM_FUSED_MOE_CHUNK_SIZE
59+
# The size of the activations will be E x MOE_DP_CHUNK_SIZE x hidden_dim.
60+
MOE_DP_CHUNK_SIZE = 256
6061

6162

6263
@dataclass

0 commit comments

Comments
 (0)