Allow users to checkpoint during training and then use various checkpoints during inference
Allow users to checkpoint during training and then use various checkpoints during inference