GitHub · Where software is built

Labels Milestones New issue

goose keyring errors on MacOS and Linux

#30

· ct-parker opened

on Sep 5, 2025

runner.py fails to use temporary Goose config on Windows

#29

· ct-parker opened

on Sep 5, 2025

Support grouping for cases in metacoder config

#27

· ct-parker opened

on Sep 4, 2025

Support CBORG in judges.py

#26

· ct-parker opened

on Sep 4, 2025

YAML document delimiters are sometimes contained in eval results

#25

· ct-parker opened

on Sep 3, 2025

Eval results are repeatedly overwritten when running a test suite

#24

· ct-parker opened

on Sep 2, 2025

Errors resulting from incorrect character encoding for sub-processes

#23

· ct-parker opened

on Sep 2, 2025

Forward slashes in test case names result in incorrect eval directory structure

#22

· ct-parker opened

on Sep 2, 2025

Test case names can result in invalid eval directory names

#21

· ct-parker opened

on Sep 2, 2025

If OpenAI calls fail for any reason in the metacoder runner, the code gets caught in a try/fail/repeat loop

#20

· ct-parker opened

on Aug 30, 2025

When server_combinations are missing from config.yaml, the models settings are ignored, defaulting to openai and gpt40

#19

· ct-parker opened

on Aug 30, 2025

Model eval gets caught in a loop if the endpoint returns HTTP errors.

#18

· ct-parker opened

on Aug 29, 2025