Evaluation Hpatches - Recall Error?

[NoahYildiz]

For some reason during the evaluation of lightglue I get these values. The Precision seems to be the same as in the paper but the recall ist not. Actually the Recall @1px and @3px is the same as the precision.

{
"mprec@1px": 0.334,
"mrecall@1px": 0.334,
"mprec@3px": 0.941,
"mrecall@3px": 0.941,
"mnum_matches": 584.0,
"mnum_keypoints": 1024.0,
"mH_error_dlt": null,
"H_error_dlt@1px": 0.3512,
"H_error_dlt@3px": 0.672,
"H_error_dlt@5px": 0.7753,
"H_error_ransac@1px": 0.3414,
"H_error_ransac@3px": 0.5752,
"H_error_ransac@5px": 0.6957,
"H_error_ransac_mAA": 0.5374333333333333,
"mH_error_ransac": 1.135,
"mransac_inl": 101.0,
"mransac_inl%": 0.183
}

[Phil26AT]

Hey @NoahYildiz, thank you for reporting this. However, I cannot find where you get "mrecall@3px" from, I cannot find this metric in the codebase. Nevertheless, I added the recall metrics in PR #162. On my end I get a recall of 96.1 on hpatches. Let me know if this resolves your issue.

[NoahYildiz]

Thanks for your Answer, I think I did a mistake there by trying to add the recall on my own on a fork a few months ago.
Thanks for adding the Metric!