Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

arxiv: 2305.01210

AutoTrain Compatible

Inference Endpoints

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

6

Full-text search

Active filters: 2305.01210

neuralmagic/starcoder2-15b-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 72

neuralmagic/starcoder2-3b-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 88

neuralmagic/starcoder2-7b-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 85

neuralmagic/starcoder2-3b-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 131

neuralmagic/starcoder2-7b-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 88

neuralmagic/starcoder2-15b-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 12