Skip to content

Commit 109e978

Browse files
andyxningZhengHongming888
authored andcommitted
[Docs] add runai_streamer_sharded to LoadConfig (vllm-project#27937)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
1 parent db96d97 commit 109e978

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

vllm/config/load.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -40,6 +40,8 @@ class LoadConfig:
4040
more information.\n
4141
- "runai_streamer" will load the Safetensors weights using Run:ai Model
4242
Streamer.\n
43+
- "runai_streamer_sharded" will load weights from pre-sharded checkpoint
44+
files using Run:ai Model Streamer.\n
4345
- "bitsandbytes" will load the weights using bitsandbytes quantization.\n
4446
- "sharded_state" will load weights from pre-sharded checkpoint files,
4547
supporting efficient loading of tensor-parallel models.\n

0 commit comments

Comments
 (0)