Can you support DoRA?
Hi @SJmdy 
Dora is a planned feature in the near future. We plan on supporting it once to transition to NeMo 2.0 is mature. This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days. This issue was closed because it has been inactive for 7 days since being marked as stale.
Hi Team,
Do you have any plans to support DoRA?

Paper: https://arxiv.org/abs/2402.09353
peft: https://github.com/huggingface/peft/pull/1474

Thank you
