Skip to content

Commit 8731c83

Browse files
Distinguish slower, same and faster comparisons
Fixes: #178
1 parent 92286e1 commit 8731c83

File tree

1 file changed

+5
-2
lines changed

1 file changed

+5
-2
lines changed

scripts/nvbench_compare.py

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -218,10 +218,13 @@ def extract_value(summary):
218218
status = Fore.YELLOW + "????" + Fore.RESET
219219
elif abs(frac_diff) <= min_noise:
220220
pass_count += 1
221-
status = Fore.GREEN + "PASS" + Fore.RESET
221+
status = Fore.BLUE + "SAME" + Fore.RESET
222+
elif diff < 0:
223+
failure_count += 1
224+
status = Fore.GREEN + "FAST" + Fore.RESET
222225
else:
223226
failure_count += 1
224-
status = Fore.RED + "FAIL" + Fore.RESET
227+
status = Fore.RED + "SLOW" + Fore.RESET
225228

226229
if abs(frac_diff) >= threshold:
227230
row.append(format_duration(ref_time))

0 commit comments

Comments
 (0)