Does the project support QLora
This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days. This issue was closed because it has been inactive for 7 days since being marked as stale. @minitu Is there any plan for QloRA support ? thanks.
**Is your feature request related to a problem? Please describe.**

I have limit gpu resources， so I want to use qlora with model paralelism for LLM model.

**Describe the solution you'd like**

Using qlora and model paralelism or pipeline parallelism together。

**Describe alternatives you've considered**

None

**Additional context**

None
