hugging-quants
/

Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Resources

View closed (13)

Finetuning AWQ model

#17 opened 3 months ago by

add base model

#16 opened 6 months ago by

No support for num_beams >1?

#15 opened 6 months ago by

The original model supported Chinese, but the current quantized version does not. Will this issue be fixed in the future?

#14 opened 6 months ago by