Hugging Face's logo

iproskurina
/
Mistral-7B-v0.3-GPTQ-4bit-g13-s0

Text Generation
Transformers
Safetensors
mistral
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
Mistral-7B-v0.3-GPTQ-4bit-g13-s0 / special_tokens_map.json

Commit History

AutoGPTQ model for mistralai/Mistral-7B-v0.3: 4 bits, gr128, desc_act=True
2972486
verified

iproskurina commited on