Skip to content

Commit 6496e87

Browse files
committed
chore: Enable graph mode for NPU platform, waiting for #25161 in vLLM now
Adds a capability flag to indicate that the NPU platform supports graph mode execution. Signed-off-by: Yizhou Liu <liu_yizhou@outlook.com>
1 parent 83816ea commit 6496e87

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

vllm_ascend/platform.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -389,3 +389,7 @@ def stateless_init_device_torch_dist_pg(
389389
@classmethod
390390
def support_hybrid_kv_cache(cls) -> bool:
391391
return True
392+
393+
@classmethod
394+
def support_static_graph_mode(cls) -> bool:
395+
return True

0 commit comments

Comments
 (0)