Private leaderboard evaluation

[tommycarpi]

I'd like to have some clarifications about the private leaderboard evaluation.
Is it the best score reached ever, or the corresponding value of the public leaderboard score?

I'll provide an example to be more clear

submission_x has:
public_leaderboard: 100
private_leaderboard: 90

while submission_y has:
public_leaderboard: 95
private_leaderboard: 95

Clearly in the public leaderboard my team would score 100 (submission_x), but what for the private?
Will it be 90 or 95??

[desertnaut]

I have seen no mention for such a public/private leaderboard distinction (in contrast to Kaggle contests, where it is explicitly mentioned in the rules for each competition). Can we please have a clarification here?

[tommycarpi]

I assumed there is a Private Leaderboard based on the fact that here, under the Prizes Section, it is explicitly said that the Public Leaderboard is based on 1/3 of the ground truth data.

[desertnaut]

Good spot - it had gone under my radar, thanks

[fabianabel]

Sorry for the late reply. Yes, the public leaderboard is based on 1/3 of the ground truth data. The final leaderboard with the official results will be released on June 29th (a few ays after the challenge finished) and will be based on 100% of the ground truth data.