Quantized GGUF models for QwQ-0.5B-Distilled

GGUF

Model size

494M params

Architecture

qwen2

16-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for kz919/QwQ-0.5B-Distilled-gguf

Base model

Finetuned

Quantized

(95)

this model

kz919
/

QwQ-0.5B-Distilled-gguf