-
Notifications
You must be signed in to change notification settings - Fork 25
Description
Description
Current Behavior
When attempting to send Cypress test results to TestRail, if any case_id is not part of the targeted TestRail run, the entire process fails with an error:
Could not send list of Cypress results to TestRail: 400 Bad Request >> Field :results contains one or more invalid results (case C62597 unknown or not part of the test run)
This causes all test results to fail to be reported, even those with valid case IDs.
Proposed Solution
Add a configuration option to skip test cases that aren't part of the test run instead of failing the entire process.
When enabled, the module would:
- Continue processing valid test cases
- Log which case IDs were skipped
- Successfully upload results for all valid cases
Expected Output
With this option enabled, the output would look something like:
Test case C62600 is not valid for run R26444. Skipping.
Test case C62597 is not valid for run R26444. Skipping.
Cypress results sent to TestRail R26444 for: C40039, C40040, C40041, C40043
Implementation Suggestion
Consider adding a new configuration option such as validateCaseIds: true
that users can set in their configuration.