mahihossain666
/

llama-2-70b-hf-quantized-4bits-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

llama-2-70b-hf-quantized-4bits-GPTQ / README.md

mahihossain666's picture

Update README.md

7a65f4a about 1 year ago

|

history blame contribute delete

87 Bytes

metadata

datasets:
  - allenai/c4
license: pddl

Quantized to 4bit precision using AutoGPTQ