When loading a checkpoint file and continue training, the old validation_scores.csv should be copied and appended. Mind the iteration number.