iproskurina
/

Mistral-7B-v0.3-GPTQ-4bit-g13-s0

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Mistral-7B-v0.3-GPTQ-4bit-g13-s0 / tokenizer.json

iproskurina's picture

AutoGPTQ model for mistralai/Mistral-7B-v0.3: 4 bits, gr128, desc_act=True

2972486 verified 24 days ago

history contribute delete

3.67 MB

File too large to display, you can check the raw version instead.