online hard-example mining under Multi-GPU (DDP) #1493
Description
🚀 The feature
Do you think it would be possible to have an off the shelf component like the one described at Lightning-AI/pytorch-lightning#1170?
Motivation, pitch
Sometime on unbalanced dataset it could be interesting to make specific sampling related to perplexity or othermetrics and loss values.
It could be also interesting for implementing some type of online curriculum learning/sampling solution.
Alternatives
No response
Additional context
Write and maintain a custom component.