mahihossain666
/

llama-2-70b-hf-quantized-4bits-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

llama-2-70b-hf-quantized-4bits-GPTQ / README.md

mahihossain666's picture

Update README.md

7a65f4a about 1 year ago

|

history blame contribute delete

87 Bytes

	---
	datasets:
	- allenai/c4
	license: pddl
	---
	Quantized to 4bit precision using AutoGPTQ