neuralmagic/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-FP8-dynamic Text Generation • Updated Dec 19, 2024 • 30
neuralmagic/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-quantized.w4a16 Text Generation • Updated Dec 19, 2024 • 16
ModelCloud/Falcon3-10B-Instruct-gptqmodel-4bit-vortex-v1 Text Generation • Updated Dec 21, 2024 • 8 • 3
neuralmagic/granite-3.1-2b-instruct-quantized.w4a16 Text Generation • Updated about 1 month ago • 150
neuralmagic/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16 Text Generation • Updated 1 day ago • 1.72k • 2
neuralmagic/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16 Text Generation • Updated 1 day ago • 1.41k • 2
neuralmagic/Llama-3.2-11B-Vision-Instruct-quantized.w4a16 Image-Text-to-Text • Updated 10 days ago • 61