Top5-accuracy is not a good metric for this problem.

[thanhnguyentung95]

It sounds very impressive for at first when looking at the 99.8% top-5 accuracy for attribute prediction task. However, simply predicting probabilities of all attribute is 0, then the accuracy is still > 99%.