Skip to content

Commit 37c3cc1

Browse files
committed
fix qwen2.5 omni new transformers compat
1 parent 274d1f8 commit 37c3cc1

File tree

2 files changed

+84
-262
lines changed

2 files changed

+84
-262
lines changed

notebooks/qwen2.5-omni-chatbot/qwen2.5-omni-chatbot.ipynb

Lines changed: 82 additions & 260 deletions
Large diffs are not rendered by default.

notebooks/qwen2.5-omni-chatbot/qwen2_5_omni_helper.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1570,10 +1570,10 @@ def forward(
15701570
thinker_reply_part=thinker_reply_part,
15711571
)
15721572

1573-
def _get_initial_cache_position(self, input_ids, model_kwargs):
1573+
def _get_initial_cache_position(self, input_ids, device, model_kwargs):
15741574
# Talker needs to calculate cache_position with input_ids, so pop inputs_embeds temporarily
15751575
inputs_embeds = model_kwargs.pop("inputs_embeds")
1576-
model_kwargs = super()._get_initial_cache_position(input_ids, model_kwargs)
1576+
model_kwargs = super()._get_initial_cache_position(input_ids, device, model_kwargs)
15771577
model_kwargs["inputs_embeds"] = inputs_embeds
15781578
return model_kwargs
15791579

0 commit comments

Comments
 (0)