Skip to content

Remove prediction suppression#851

Merged
czaloom merged 3 commits into
mainfrom
czaloom-remove-pd-suppression-10-7-25
Oct 8, 2025
Merged

Remove prediction suppression#851
czaloom merged 3 commits into
mainfrom
czaloom-remove-pd-suppression-10-7-25

Conversation

@czaloom

@czaloom czaloom commented Oct 7, 2025

Copy link
Copy Markdown
Collaborator

Issue

Average Precision and Average Recall are currently not computed for labels that do not appear in the ground truth set. This is potentially problematic as a model could be highly confident in a label that is present in the real-world but not in the evaluation set leading to the suppression of certain labels.

Severity

LOW - This is likely not going to affect any existing evaluations as label sets are generally well-represented in training and validation sets. However, this could greatly affect one-off evaluations over smaller sets of data.

Solution

Remove suppression and update AP and AR derivative metrics.

  • AP, mAP, APAveragedOverIOUS, mAPAveragedOverIOUs
  • AR, mAR, ARAveragedOverScores, mARAveragedOverScores

@czaloom czaloom merged commit cc4073c into main Oct 8, 2025
4 checks passed
@czaloom czaloom deleted the czaloom-remove-pd-suppression-10-7-25 branch October 8, 2025 14:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants