add war fix for sync issues
jenkins
# What does this PR do ?

this is a war around a deeper issue where checkpointing is not guarded by pytorch distributed calls. So sometimes it removes checkpoints that don't exist and rmtree errors