Using existing weights for MIMIC-IV dataset

[pchatzina]

Hello, thank you for your great work!

I would like to ask if there is a way to create a MOTOR model instance using the weights and the tokenizer that are uploaded on HF. My goal is a prediction task on MIMIC IV dataset and the cohort is about 15000. Ideally I would like to train a classification layer keeping everything else frozen.

Thank you in advance!