Skip to content

Commit 61c19e2

Browse files
committed
fix mooncake layerwise connector
Signed-off-by: liziyu <liziyu16@huawei.com>
1 parent 2a821ff commit 61c19e2

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_ascend/distributed/mooncake_layerwise_connector.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1145,7 +1145,7 @@ def save_kv_layer(self, layer_name: str, kv_layer: Tuple[torch.Tensor,
11451145
connector_metadata: MooncakeLayerwiseConnectorMetadata,
11461146
**kwargs) -> None:
11471147
"""MooncakeLayerwiseConnector does not save explicitly."""
1148-
if self.kv_role == 'kv_producer' and connector_metadata.request.keys():
1148+
if self.kv_role == 'kv_producer' and connector_metadata.requests.keys():
11491149
if self.pd_head_ratio != 1:
11501150
if self.current_layer != 0:
11511151
self.completion_event.wait()

0 commit comments

Comments
 (0)