Skip to content

Commit 5d285c5

Browse files
committed
chore: update configs
1 parent d34dbb8 commit 5d285c5

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

diffulex_bench/configs/llada2_mini_dmax_gsm8k.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ engine:
1717
gpu_memory_utilization: 0.5
1818
max_model_len: 2048
1919
max_num_batched_tokens: 4096
20-
max_num_reqs: 1
20+
max_num_reqs: 128
2121

2222
enforce_eager: true
2323
enable_prefix_caching: true
@@ -40,7 +40,7 @@ engine:
4040
eval:
4141
dataset_name: "gsm8k_diffulex_dmax_chat"
4242
dataset_split: "test"
43-
dataset_limit: 100
43+
dataset_limit: null
4444
temperature: 0.0
4545
max_tokens: 256
4646
output_dir: "benchmark_results/llada2_mini_dmax_gsm8k_tp1"

0 commit comments

Comments
 (0)