This repository implements SimMIM (Simple Masked Image Modeling) using MONAI, tailored for self-supervised representation learning on 3D medical imaging data.
β οΈ This is a research/experimental notebook primarily run in Google Colab.
SimMIM is a self-supervised learning method that trains a vision transformer (ViT) to reconstruct masked patches of an image. This project adapts that approach for 3D volumetric medical images using MONAI and PyTorch.
data_utils_colab_final_backup.ipynb: Main Colab notebook with SimMIM implementation using MONAI.
To run this notebook:
- Open it in Google Colab.
- Make sure to enable GPU runtime.
- Install MONAI and dependencies:
pip install monai[all] torch torchvision