Skip to content

Commit 65ee8f4

Browse files
committed
Fix bug with Qwen
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
1 parent 57733ca commit 65ee8f4

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/models/qwen2.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -352,8 +352,8 @@ def forward(
352352
hidden_states = intermediate_tensors["hidden_states"]
353353
residual = intermediate_tensors["residual"]
354354

355+
aux_hidden_states = []
355356
if len(self.aux_hidden_state_layers) > 0:
356-
aux_hidden_states = []
357357
for idx, layer in enumerate(
358358
self.layers[self.start_layer:self.end_layer]):
359359
if idx in self.aux_hidden_state_layers:

0 commit comments

Comments
 (0)