Skip to content

Commit 60c0a7f

Browse files
author
lwq
committed
fix enable_kv_nz
Signed-off-by: lwq <liwenquan5@huawei.com>
1 parent 9a3963a commit 60c0a7f

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_ascend/attention/mla_v1.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -482,7 +482,7 @@ def __init__(
482482
ascend_config = get_ascend_config()
483483
self.enable_shared_expert_dp = ascend_config.enable_shared_expert_dp
484484
self.enable_mla_prefetch = ascend_config.enable_mla_prefetch
485-
self.exable_kv_nz = ascend_config.enable_kv_nz
485+
self.exable_kv_nz = ascend_config.torchair_graph_config.enable_kv_nz
486486

487487
# Adapt torch air graph mode with spec decoding.
488488
speculative_config = get_current_vllm_config().speculative_config

0 commit comments

Comments
 (0)