ReFrame 4.8.0

Release Notes

New features

• Support list assignment from JSON using the -S option (#3449)
• Support discrete testcase filters when comparing performance (#3438)
• Do not emit the -lselect option if num_tasks=None (#3452)
• Allow changing the default mount location of stagedir inside containers (#3442)
• Support selecting A/B column variants in performance comparisons (#3431)
• Support reference values of zero (#3434)
• Allow scoping session-based DB queries by time (#3403)
• Store test sub-result per performance variable (#3414)
• Add support for configure directory in CMake builds (#3395)
• Enable YAML configuration files (#3370)
• Introduce %(hostname)s log format placeholder (#3346)

Enhancements

• Document the requirement of file lock support for enabling results storage (#3457)
• Add a note about results storage and analytics in README (#3453)
• Use correct OMP_PROC_BIND arguments in the tutorial examples (#3435)
• List parameterized tests in their instantiation order (#3440)
• Add warning about combining build_locally=0 and scheduler backends that cannot reliably retrieve the job's exit code (#3426)

Bug fixes

• Correctly handle verbatim scheduler options passed in the CLI in the remote auto-detection script (#3456)
• Treat correctly failed_stage=None in failure stats report (#3454)
• Fix constraint evaluation for Slurm features starting with numbers (#3448)
• Fix lock order when storing reports to the database (#3450)
• Update special parameter character in test name (#3441)
• Disallow command options from execution modes (#3432)
• Fix calculation of lower/upper reference bounds when their absolute value reaches zero (#3433)
• Insert new line between stdout/stderr listings in failures (#3429)
• Disable number parsing when in --list-stored-sessions (#3425)

Other

• Add GH action to test EOL python versions (#3417)
• Enabled slurmdbd in Docker compose setup (#3391)
• Use Python 3.13 to publish to PyPI (#3406)
• Update YAML unit test config (#3405)
• Replace symlinks with file copies in Docker compose config for Github workflows (#3396)
• Remove stale Dockerfiles (#3387)
• Update Slurm cluster images to ubuntu:22.04 (#3383)