Imported from https://github.com/sidps/dist_training