Skip to content

Commit 137ed46

Browse files
committed
[ci]fix ci.
Signed-off-by: offline0806 <3337230449@qq.com>
1 parent 695bb39 commit 137ed46

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

docs/source/user_guide/feature_guide/eplb_swift_balancer.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -25,24 +25,30 @@ would be hidden by eplb worker process too.
2525
## Examples
2626
### Dynamic eplb
2727
Enable dynamic eplb and specify the trigger rounds.
28+
2829
```shell
2930
vllm serve Qwen/Qwen3-235B-A22 \
3031
--tensor-parallel-size 16 \
3132
--enable-expert-parallel \
3233
--additional-config '{ "dynamic_eplb":true,"num_iterations_eplb_update":400, "gate_eplb":true, "num_wait_worker_iterations":30}'
3334
```
35+
3436
### Static eplb
3537
1. Specify the path for the static eplb initialization file.
38+
3639
```shell
3740
vllm serve Qwen/Qwen3-235B-A22 \
3841
--tensor-parallel-size 16 \
3942
--enable-expert-parallel \
4043
--additional-config '{ "expert_map_record_path": "/path/to/eplb.json", "init_redundancy_expert": 16, dynamic_eplb":true,"num_iterations_eplb_update":400, "gate_eplb":true, "num_wait_worker_iterations":30}'
4144
```
45+
4246
2. If expert map has been recorded, enable static eplb with expert map path.
47+
4348
```shell
4449
vllm serve Qwen/Qwen3-235B-A22 \
4550
--tensor-parallel-size 16 \
4651
--enable-expert-parallel \
4752
--additional-config '{ "expert_map_path": "/path/to/eplb.json"}'
4853
```
54+

0 commit comments

Comments
 (0)