Skip to content

Commit 17923ad

Browse files
committed
Get Mamba2 working!
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
1 parent c956a30 commit 17923ad

File tree

4 files changed

+940
-2
lines changed

4 files changed

+940
-2
lines changed

vllm/model_executor/layers/mamba/mamba_mixer2.py

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -174,7 +174,6 @@ def __init__(self,
174174
intermediate_size: int,
175175
use_conv_bias: bool,
176176
use_bias: bool,
177-
use_rms_norm: bool,
178177
n_groups: int = 1,
179178
num_heads: int = 128,
180179
head_dim: int = 64,
@@ -203,7 +202,6 @@ def __init__(self,
203202
"Tensor parallel world size must divide num heads."
204203

205204
self.ssm_state_size = ssm_state_size
206-
self.use_rms_norm = use_rms_norm
207205
self.activation = activation
208206

209207
self.chunk_size = chunk_size

0 commit comments

Comments
 (0)