turboderp
/

Llama-3.1-8B-Instruct-exl3

Model card Files Files and versions

EXL3 quants of Llama-3.1-8B-Instruct

2.00 bits per weight
2.25 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for turboderp/Llama-3.1-8B-Instruct-exl3

Base model

meta-llama/Llama-3.1-8B

Finetuned

meta-llama/Llama-3.1-8B-Instruct

Quantized

(898)

this model

Collection including turboderp/Llama-3.1-8B-Instruct-exl3

EXL3 models

70 items • Updated about 19 hours ago • 66