Skip to content

Commit f8977c2

Browse files
authored
Fix an error in dummy weight loading for quantization models (vllm-project#18855)
Signed-off-by: Chenyaaang <chenyangli@google.com>
1 parent f274581 commit f8977c2

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/model_loader/weight_utils.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -696,7 +696,7 @@ def initialize_dummy_weights(
696696
# Note: We avoid using torch.rank_like as it doesn't currently
697697
# support the generator argument.
698698
param.copy_((high - low) *
699-
torch.rand(*param.shape,
699+
torch.rand(param.shape,
700700
generator=generator,
701701
dtype=param.dtype,
702702
layout=param.layout,

0 commit comments

Comments
 (0)