Skip to content

Commit f52aa4b

Browse files
Distinguish slower, same and faster comparisons (#190)
Fixes: #178
1 parent 0ce45af commit f52aa4b

File tree

1 file changed

+5
-2
lines changed

1 file changed

+5
-2
lines changed

scripts/nvbench_compare.py

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -247,10 +247,13 @@ def extract_value(summary):
247247
status = Fore.YELLOW + "????" + Fore.RESET
248248
elif abs(frac_diff) <= min_noise:
249249
pass_count += 1
250-
status = Fore.GREEN + "PASS" + Fore.RESET
250+
status = Fore.BLUE + "SAME" + Fore.RESET
251+
elif diff < 0:
252+
failure_count += 1
253+
status = Fore.GREEN + "FAST" + Fore.RESET
251254
else:
252255
failure_count += 1
253-
status = Fore.RED + "FAIL" + Fore.RESET
256+
status = Fore.RED + "SLOW" + Fore.RESET
254257

255258
if abs(frac_diff) >= threshold:
256259
row.append(format_duration(ref_time))

0 commit comments

Comments
 (0)