Skip to content

Commit fa018f3

Browse files
committed
chore: modify configs
1 parent 208d144 commit fa018f3

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

diffulex_bench/configs/llada2_mini_dmax_gsm8k.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -15,9 +15,9 @@ engine:
1515
tensor_parallel_size: 1
1616
data_parallel_size: 1
1717
gpu_memory_utilization: 0.5
18-
max_model_len: 2048
18+
max_model_len: 4096
1919
max_num_batched_tokens: 4096
20-
max_num_reqs: 128
20+
max_num_reqs: 64
2121

2222
enforce_eager: false
2323
attn_impl: "triton"

0 commit comments

Comments
 (0)