Skip to content

Commit 25d7544

Browse files
committed
Fix bug with Qwen
1 parent d7591ee commit 25d7544

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/models/qwen2.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -352,8 +352,8 @@ def forward(
352352
hidden_states = intermediate_tensors["hidden_states"]
353353
residual = intermediate_tensors["residual"]
354354

355+
aux_hidden_states = []
355356
if len(self.aux_hidden_state_layers) > 0:
356-
aux_hidden_states = []
357357
for idx, layer in enumerate(
358358
self.layers[self.start_layer:self.end_layer]):
359359
if idx in self.aux_hidden_state_layers:

0 commit comments

Comments
 (0)