Skip to content

Commit 6bfc209

Browse files
Check the test
Signed-off-by: zhihaofang1017 <zhihaofang1017@outlook.com>
1 parent 52f8fa2 commit 6bfc209

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm_ascend/ops/rotary_embedding.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -288,7 +288,8 @@ def mrope_forward(
288288
import torch_npu
289289
mrope_section = [0, 0, 0] if positions.ndim == 1 else self.mrope_section
290290

291-
query, key = torch_npu.npu_mrope(positions.clone().detach().contiguous(),
291+
positions = positions
292+
query, key = torch_npu.npu_mrope(positions,
292293
query.contiguous(),
293294
key.contiguous(),
294295
self.cos_sin_cache.contiguous(),

0 commit comments

Comments
 (0)