Skip to content

Commit 6c46bbe

Browse files
[Test] Update accuarcy template
Signed-off-by: hfadzxy <starmoon_zhang@163.com>
1 parent c90a6d3 commit 6c46bbe

File tree

1 file changed

+7
-6
lines changed

1 file changed

+7
-6
lines changed

tests/e2e/models/report_template.md

Lines changed: 7 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -10,20 +10,21 @@
1010

1111
```bash
1212
export MODEL_ARGS={{ model_args }}
13-
lm_eval --model {{ model_type }} --model_args $MODEL_ARGS --tasks {{ datasets }} \
14-
{% if apply_chat_template is defined and (apply_chat_template|string|lower in ["true", "1"]) -%}
13+
lm_eval --model {{ model_type }} --model_args $MODEL_ARGS \
14+
--tasks {{ datasets }} \
15+
{%- if apply_chat_template is defined and (apply_chat_template|string|lower in ["true", "1"]) %}
1516
--apply_chat_template \
1617
{%- endif %}
17-
{% if fewshot_as_multiturn is defined and (fewshot_as_multiturn|string|lower in ["true", "1"]) -%}
18+
{%- if fewshot_as_multiturn is defined and (fewshot_as_multiturn|string|lower in ["true", "1"]) %}
1819
--fewshot_as_multiturn \
1920
{%- endif %}
20-
{% if num_fewshot is defined and num_fewshot != "N/A" -%}
21+
{%- if num_fewshot is defined and num_fewshot != "N/A" %}
2122
--num_fewshot {{ num_fewshot }} \
2223
{%- endif %}
23-
{% if limit is defined and limit != "N/A" -%}
24+
{%- if limit is defined and limit != "N/A" %}
2425
--limit {{ limit }} \
2526
{%- endif %}
26-
--batch_size {{ batch_size }}
27+
--batch_size {{ batch_size }}
2728
```
2829
2930
| Task | Metric | Value | Stderr |

0 commit comments

Comments
 (0)