Generalize OpenCLIP Prisma weights and test to all sorts of OpenCLIP models

[soniajoseph]

RIght now, the OpenCLIP test is currently on this specific model, but it'd be nice to have the test be general for all sorts of models.

Consult the original OpenCLIP code to see how they load models, so we can write general functions that adapt all OpenCLIP weights.

https://github.com/soniajoseph/ViT-Prisma/blob/sonia-open-clip-acc-baseline/tests/test_loading_CLIP-ViT-B-32-DataComp.XL-s13B-b90K.py