How to apply CoCa (open-clip weights)

[biopzhang]

Dear develepper(s) and fellow diffusioners,

Could you please give some insights on how to load the CoCa pre-trained model (using open-clip implementation) in dalle2-pytorch?

Thank you so much!
P.