Skip to content

[Installation]: Failed to install vllm-ascend from source #804

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
tongtong0613 opened this issue May 10, 2025 · 2 comments
Open

[Installation]: Failed to install vllm-ascend from source #804

tongtong0613 opened this issue May 10, 2025 · 2 comments

Comments

@tongtong0613
Copy link

tongtong0613 commented May 10, 2025

env:

PTA: 7.1.RC1.B020
CANN: 8.2.RC1.B020

install command:

export COMPILE_CUSTOM_KERNELS=1
python setup.py install

error message:

Function AscendcCompiler at line 98, Command excution failed, the returnCode is non-zero!
Output of ascend_compiler: /home/vllm-ascend/csrc/kernels/pos_encoding_kernels.cpp:357:9: error: use of undeclared identifier 'rope_custom_true_half'; did you mean 'rope_custom_true___cce_half'?

But when I use CANN 8.1.RC1.B080 , all works. Could you please help me take a look at this issue? Thank you very much.

@tongtong0613 tongtong0613 changed the title [Installation]: Failed to install vllm-ascend from source [Installation]: Failed to install vllm-ascend from source May 10, 2025
@tongtong0613
Copy link
Author

@Yikun @wangxiyuan

@Yikun
Copy link
Collaborator

Yikun commented May 10, 2025

Thanks for feedback, this is caused by CANN breaking change, we will also sync this info to CANN team.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants