Here we provide a set of basic config files, namely:
- AIMv1 pretraining on ImageNet: aimv1/001_aim_v1_600M.yaml
- AIMv2 pretraining (with an MoE variant) on an example HuggingFace dataset: aimv2/001_aimv2_hfdata.yaml and aimv2/002_aimv2_moe_hfdata.yaml
- CLIP pretraining on an example HuggingFace dataset: clip/001_clip_hfdata.yaml
- Supervised ViT on ImageNet supervised_imagenet/001_vit_large_imagenet.yaml
- LLM pretraining on an example HuggingFace dataset: text/001_llm_hfdata.yaml