YAML Metadata Warning: empty or missing yaml metadata in repo card
Check out the documentation for more information.
Quantizations of the model:
Under the following versions:
- Q4_1 (4bit);
- Q5_1 (5bit);
- Q8_0 (8bit).
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support