cannot reproduce FID of 7.32 using https://huggingface.co/PixArt-alpha/PixArt-alpha/blob/main/PixArt-XL-2-256x256-MSCOCO-FID732.pth

[Gus-Guo]

using cfg_scale=4.5, sampler=dpmsolver, randomly select 30k prompts from captions on coco2014 val split to generate 256x256 images, ckpt from https://huggingface.co/PixArt-alpha/PixArt-alpha/blob/main/PixArt-XL-2-256x256-MSCOCO-FID732.pth, I cannot reproduce FID result of 7.32. reference images are from val split and center crop into 256x256. Is there anything wrong about my config?

[lawrence-cj]

So, what's the result you get?

[Gus-Guo]

we use the same model...so confused why I can't get FID of 7.32...

[lawrence-cj]

I'll check if the ckpt is the correct one when I'm free. Busy with other issues

[Gus-Guo]

got it. Thank you very much.

[Gus-Guo]

@lawrence-cj Hi lawrence, do you have plan to disclose your FID measurement code?

[lawrence-cj]

Will update here. But no exact date.
https://github.com/PixArt-alpha/PixArt-Eval