Skip to content

Commit 80249be

Browse files
authored
[Feat] allow using aclgraph in ray backend
Signed-off-by: Signed-off-by: WithHades <244036962@qq.com>
1 parent 060981e commit 80249be

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_ascend/platform.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -172,7 +172,7 @@ def check_and_update_config(cls, vllm_config: VllmConfig) -> None:
172172
compilation_config.cudagraph_mode = CUDAGraphMode.NONE
173173

174174
# set cudaprah sizes before extending `compilation_config.splitting_ops`
175-
vllm_config._set_cudagraph_sizes()
175+
vllm_config._set_cudagraph_sizes(3)
176176

177177
if compilation_config.cudagraph_mode == CUDAGraphMode.NONE:
178178
compilation_config.level = CompilationLevel.NO_COMPILATION

0 commit comments

Comments
 (0)