GGUF quants for testing at the moment. Thank you, "mad scientist" Nitral-AI!

This model has potential! Not chaotic, and at the ideal size for most people.

Doesn't show excessive alignment, so it should be good for any scenarios/writing situations.

GGUF

Model size

12.2B params

Architecture

llama

Hardware compatibility

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Lewdiculous/CaptainErisNebula-12B-AOE-v1-GGUF-IQ-Imatrix

Base model

Finetuned

Quantized

(1)

this model

Collection including Lewdiculous/CaptainErisNebula-12B-AOE-v1-GGUF-IQ-Imatrix