Dropout module in the model

[yoyowang0109]

Hi,

I'm currently working on pre-training your model on the MIMIC-IV dataset for research purposes. I noticed that the paper mentions the use of dropout for regularization (as documented in Appendix A), but I couldn’t find any dropout modules in the released source code.

Could you clarify where dropout is applied in the model during training?

Any guidance would be greatly appreciated — thank you for sharing your work!

[EthanSteinberg]

Sorry about that. The code went through a major revision to support MEDS, and I guess that feature got dropped (I don't think it was that important for STARR-OMOP sized data). I'll leave this issue open as it should probably get added back for smaller datasets.