CPU-Hybrid-MoE/DeepSeek-R1-0528-GPU-FP8-GPTQ4
Text Generation
•
106B
•
Updated
CPU-Hybrid-MoE
community
AI & ML interests
Quantized MoE models for inference on CPU and hybrid CPU-GPU
CPU-Hybrid-MoE/DeepSeek-V3-0324-GPU-FP8-GPTQ4
Text Generation
•
106B
•
Updated
•
3
CPU-Hybrid-MoE/DeepSeek-V3-0324-CPU-NUMA4-AMXINT8
Text Generation
•
Updated
CPU-Hybrid-MoE/DeepSeek-V3-0324-CPU-NUMA4-AMXINT4
Text Generation
•
Updated
•
2
CPU-Hybrid-MoE/DeepSeek-R1-0528-CPU-NUMA2-AMXINT4
Text Generation
•
Updated
CPU-Hybrid-MoE/DeepSeek-V3-0324-CPU-NUMA2-AMXINT4
Text Generation
•
Updated
CPU-Hybrid-MoE/GLM-4.5V-GPU-weight
Image-Text-to-Text
•
33B
•
Updated
•
5
CPU-Hybrid-MoE/GLM-4.5-Air-GPU-weight
32B
•
Updated
•
2