Does Trainer hyperparameter search support deepspeed?
The main page doesn’t make this very clear. I keep running out of CPU memory and I’m starting to think maybe deepspeed integration isn’t supposed to be supported?Either that or my models aren’t getting deleted from the cpu perhaps.