🪲 [Fix]: Improve test results failure handling and reporting#6
Merged
Marius Storhaug (MariusStorhaug) merged 3 commits intomainfrom Oct 6, 2025
Merged
Conversation
There was a problem hiding this comment.
Pull Request Overview
Enhances test result failure handling by adding granular error categorization and safer null checks, aiming to provide clearer diagnostics in CI runs.
- Adds per-condition failure reason collection and reporting (missing files, not executed, failed, inconclusive, etc.).
- Introduces null-guard variables before numeric property access.
- Changes behavior of exit code to increment per failure reason instead of per failing test file.
Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.
…ility in test results
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The action now provides more detailed and actionable error messages when test results fail. When tests don't execute properly or result files are missing, you'll receive specific information about what went wrong, making it easier to diagnose and fix issues with your test suites.
Improved Error Reporting
The action now generates specific error messages for each type of test failure, including:
Each error message clearly identifies which test suite and result file is affected, helping you quickly locate and resolve issues.
Safer Property Access
The action now checks for null values before accessing test result properties (Tests, Passed, Failed, Inconclusive, NotRun). This prevents errors when processing incomplete or malformed test result files.
Better Categorization
Missing result files are now tracked separately from unexecuted tests, providing clearer insight into whether a test file wasn't found in the artifacts or if it was present but marked as not executed.