Skip to content

Commit dfddf3b

Browse files
committed
Update doc
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
1 parent c681def commit dfddf3b

File tree

2 files changed

+5
-7
lines changed

2 files changed

+5
-7
lines changed

docs/source/faqs.md

Lines changed: 4 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
## Version Specific FAQs
44

55
- [[v0.7.3.post1] FAQ & Feedback](https://github.com/vllm-project/vllm-ascend/issues/1007)
6-
- [[v0.9.0rc1] FAQ & Feedback](https://github.com/vllm-project/vllm-ascend/issues/1115)
6+
- [[v0.9.0rc2] FAQ & Feedback](https://github.com/vllm-project/vllm-ascend/issues/1115)
77

88
## General FAQs
99

@@ -69,24 +69,22 @@ If all above steps are not working, feel free to submit a GitHub issue.
6969

7070
### 7. How does vllm-ascend perform?
7171

72-
Currently, only some models are improved. Such as `Qwen2 VL`, `Deepseek V3`. Others are not good enough. In the future, we will support graph mode and custom ops to improve the performance of vllm-ascend. And when the official release of vllm-ascend is released, you can install `mindie-turbo` with `vllm-ascend` to speed up the inference as well.
72+
Currently, only some models are improved. Such as `Qwen2 VL`, `Deepseek V3`. Others are not good enough. From 0.9.0rc2, Qwen and Deepseek works with graph mode to play a good performance. What's more, you can install `mindie-turbo` with `vllm-ascend v0.7.3` to speed up the inference as well.
7373

7474
### 8. How vllm-ascend work with vllm?
7575
vllm-ascend is a plugin for vllm. Basically, the version of vllm-ascend is the same as the version of vllm. For example, if you use vllm 0.7.3, you should use vllm-ascend 0.7.3 as well. For main branch, we will make sure `vllm-ascend` and `vllm` are compatible by each commit.
7676

7777
### 9. Does vllm-ascend support Prefill Disaggregation feature?
7878

79-
Currently, only 1P1D is supported by vllm. For vllm-ascend, it'll be done by [this PR](https://github.com/vllm-project/vllm-ascend/pull/432). For NPND, vllm is not stable and fully supported yet. We will make it stable and supported by vllm-ascend in the future.
79+
Currently, only 1P1D is supported on V0 Engine. For V1 Engine or NPND support, We will make it stable and supported by vllm-ascend in the future.
8080

8181
### 10. Does vllm-ascend support quantization method?
8282

8383
Currently, w8a8 quantization is already supported by vllm-ascend originally on v0.8.4rc2 or higher, If you're using vllm 0.7.3 version, w8a8 quantization is supporeted with the integration of vllm-ascend and mindie-turbo, please use `pip install vllm-ascend[mindie-turbo]`.
8484

8585
### 11. How to run w8a8 DeepSeek model?
8686

87-
Currently, w8a8 DeepSeek is working in process: [support AscendW8A8 quantization](https://github.com/vllm-project/vllm-ascend/pull/511)
88-
89-
Please run DeepSeek with BF16 now, following the [Multi-Node DeepSeek inferencing tutorail](https://vllm-ascend.readthedocs.io/en/main/tutorials/multi_node.html)
87+
Please following the [quantization inferencing tutorail](https://vllm-ascend.readthedocs.io/en/main/tutorials/multi_npu_quantization.html) and replace model to DeepSeek.
9088

9189
### 12. There is not output in log when loading models using vllm-ascend, How to solve it?
9290

docs/source/user_guide/release_notes.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# Release note
22

3-
## v0.9.0rc1 - 2025.06.10
3+
## v0.9.0rc2 - 2025.06.10
44

55
This release contains some quick fixes for v0.9.0rc1. Please use this release instead of v0.9.0rc1.
66

0 commit comments

Comments
 (0)