nm-testing
/

tinyllama-w8a8-compressed

8-bit precision

compressed-tensors

Model card Files Files and versions

No model card

Downloads last month: 1,771

Safetensors

Model size

1B params

Tensor type

BF16

·

I8

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collections including nm-testing/tinyllama-w8a8-compressed

LLM Compressor testing

14 items • Updated 10 days ago

Models in CI

Models used in CI tests across llm-compressor, compressed-tensors, and vllm repositories. • 68 items • Updated 24 days ago