Cherry pick `Fix finalize model grad for PEFT (11065)` into `r2.0.0`
[🤖]: Hi @cuichenx 👋,<br><br>we've cherry picked #11065 into `r2.0.0` for you! 🚀<br><br>Please review and approve this cherry pick by your convenience\!