Hi team, great work on the pipeline. As the heading suggests, this might be an enhancement on the existing codebase but could be quite helpful when training Large Datasets with the NERDA pipeline.
Some early pointers to implementation-
https://pytorch.org/docs/master/notes/serialization.html#recommend-saving-models
https://discuss.pytorch.org/t/how-to-save-a-model-from-a-previous-epoch/20252/2