Skip to content
Snippets Groups Projects
Verified Commit c4d43653 authored by Simon Schwitanski's avatar Simon Schwitanski :slight_smile:
Browse files

Only caculate RE and TO on correct test cases

parent b88caaab
Branches
No related tags found
1 merge request!20Parsing and tools updates
......@@ -384,8 +384,8 @@ def categorize(tool, toolname, test, test_id, logs_dir, autoclean=False):
result = {
"CE": outcome["status"] == "UNIMPLEMENTED",
"TO": outcome["status"] == 'timeout',
"RE": outcome["status"] == 'failure',
"TO": outcome["status"] == 'timeout' and test["expect"] != "ERROR", # only count timeouts for correct test cases
"RE": outcome["status"] == 'failure' and test["expect"] != "ERROR", # only count runtime errors for correct test cases
"elapsed": elapsed,
"ERROR_EXPECTED": test["expect"] == "ERROR",
"any_error_reported": False,
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment