Kubeflow trainer model checkpointing poc

This repo is a PoC exploration of how checkpointing might be integrated into the kubeflow sdk trainer client.