EXL2 Quants
Collection
28 items
•
Updated
Configuration Parsing
Warning:
In config.json: "quantization_config.bits" must be an integer
Join our Discord! https://discord.gg/Nbv9pQ88Xb
4000 members strong 💪
BeaverAI proudly presents...
Anubis Pro 105B v1 🐩
Special Thanks
- Thank you to each and everyone who donated and subscribed in Ko-Fi to make our venture a little bit easier.
- I'm also recently unemployed. I am a Software Developer with 8 years of experience in Web, API, AI, and adapting to new tech and requirements. If you're hiring, feel free to reach out to me however.
Supported Chat Template
- Llama 3 Chat for RP and Instrut
- Alpaca for Story Adventure
Description
An upscaled version of Llama 3.3 70B with 50% more layers. Finetuned further to make use of its new layers.
I'm really liking it so far. I haven't noticed any slop, the writing is good, very creative. (I know it's an overused term, but compared to other L3.3 finetunes, it really does feel so.). Definitely deserves a release. I've seen many unique generations in an hour that I've never seen before with other finetunes.
yea it writes like abliterated 3.3, follows my intended writing style nicely
Links
- Downloads last month
- 3
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support