Skip to content

Conversation

wangxiyuan
Copy link
Collaborator

Add unpadded Qwen2.5-VL for verl scenario.

When using vllm-ascend for verl scenario, set USE_OPTIMIZED_QWEN2_5_VL (default 1) to 0 to use unpadded Qwen2.5-VL to avoid errors.

This is cherry-picked from 0.7.3-dev

@wangxiyuan
Copy link
Collaborator Author

@Yikun just a simple cherry-pick

Copy link

github-actions bot commented Jun 6, 2025

This pull request has conflicts, please resolve those before we can evaluate the pull request.

@wangxiyuan wangxiyuan added the ready read for review label Jun 6, 2025
@github-actions github-actions bot removed the ready read for review label Jun 6, 2025
…ct#928)

Add unpadded Qwen2.5-VL for verl scenario.

When using vllm-ascend for verl scenario, set `USE_OPTIMIZED_QWEN2_5_VL`
(default `1`) to `0` to use unpadded Qwen2.5-VL to avoid errors.

---------

Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
@wangxiyuan wangxiyuan added the ready read for review label Jun 7, 2025
Copy link
Collaborator

@Yikun Yikun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Consider it's just a cherrypick, I'm OK with this.

VLLM_ASCEND_USE_OPTIMIZED_QWEN2_5_VL maybe more reasonable here.

@wangxiyuan wangxiyuan merged commit c874214 into vllm-project:main Jun 7, 2025
27 checks passed
@wangxiyuan
Copy link
Collaborator Author

Consider it's just a cherrypick, I'm OK with this.

VLLM_ASCEND_USE_OPTIMIZED_QWEN2_5_VL maybe more reasonable here.

Thanks, I plan to refactor env to keep the same prefix in the next release

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
module:core ready read for review
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants