Describe the bug
There appears to be a score discrepancy and potential data contamination on the ADMET Leaderboard for the Bioavailability_Ma task. It seems that the submission values/scores for Pgp_Broccatelli were accidentally applied to Bioavailability_Ma, as the scores for several overlapping models across both leaderboards are identical.
To Reproduce
Steps to reproduce the behavior:
- Go to the TDC ADMET Leaderboard.
- Compare the model scores/rankings for the
Bioavailability_Ma task.
- Compare them with the scores for the
Pgp_Broccatelli task.
- See the identical scores across multiple overlapping models.
Expected behavior
The Bioavailability_Ma leaderboard should display the correct, independent evaluation scores for the submitted models based on the Bioavailability dataset, rather than duplicating the Pgp_Broccatelli results.
Screenshots
Environment:
- OS: N/A (Web platform issue)
- TDC version: Leaderboard Website
Additional context
First of all, thank you for maintaining the TDC Leaderboard; it has been incredibly useful for my research.
I noticed this issue while analyzing the benchmarks. Since the scores of several models perfectly match between the two completely different tasks (Bioavailability_Ma and Pgp_Broccatelli), it strongly suggests a data mapping or logging error during the leaderboard update.
Best regards,
Taekyeong An
Describe the bug
There appears to be a score discrepancy and potential data contamination on the ADMET Leaderboard for the
Bioavailability_Matask. It seems that the submission values/scores forPgp_Broccatelliwere accidentally applied toBioavailability_Ma, as the scores for several overlapping models across both leaderboards are identical.To Reproduce
Steps to reproduce the behavior:
Bioavailability_Matask.Pgp_Broccatellitask.Expected behavior
The
Bioavailability_Maleaderboard should display the correct, independent evaluation scores for the submitted models based on the Bioavailability dataset, rather than duplicating thePgp_Broccatelliresults.Screenshots
Environment:
Additional context
First of all, thank you for maintaining the TDC Leaderboard; it has been incredibly useful for my research.
I noticed this issue while analyzing the benchmarks. Since the scores of several models perfectly match between the two completely different tasks (
Bioavailability_MaandPgp_Broccatelli), it strongly suggests a data mapping or logging error during the leaderboard update.Best regards,
Taekyeong An