RedHatAI/granite-3.1-8b-instruct-GGUF
8B
•
Updated
•
5
RedHatAI/Sparse-Llama-3.1-8B-2of4
Text Generation
•
8B
•
Updated
•
69
•
62
RedHatAI/Qwen2.5-Math-7B-Instruct-FP8-dynamic
8B
•
Updated
RedHatAI/Qwen2.5-0.5B-Instruct-quantized.w8a8
Text Generation
•
0.6B
•
Updated
•
49
RedHatAI/Qwen2.5-72B-FP8-dynamic
Text Generation
•
73B
•
Updated
•
2
•
1
RedHatAI/Qwen2.5-72B-quantized.w8a8
Text Generation
•
73B
•
Updated
•
6
RedHatAI/Qwen2.5-14B-quantized.w8a8
Text Generation
•
15B
•
Updated
•
7
•
2
RedHatAI/Qwen2.5-14B-FP8-dynamic
Text Generation
•
15B
•
Updated
•
99
•
2
RedHatAI/Qwen2.5-7B-quantized.w8a8
Text Generation
•
8B
•
Updated
•
4
•
1
RedHatAI/Qwen2.5-3B-FP8-dynamic
Text Generation
•
3B
•
Updated
•
11
RedHatAI/Qwen2.5-1.5B-FP8-dynamic
Text Generation
•
2B
•
Updated
•
28
RedHatAI/Qwen2.5-0.5B-FP8-dynamic
Text Generation
•
0.6B
•
Updated
•
2
RedHatAI/Qwen2.5-3B-quantized.w8a8
Text Generation
•
3B
•
Updated
•
1
RedHatAI/Qwen2.5-1.5B-quantized.w8a8
Text Generation
•
2B
•
Updated
•
307k
•
2
RedHatAI/Qwen2.5-0.5B-quantized.w8a8
Text Generation
•
0.6B
•
Updated
•
18
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a8
Text Generation
•
406B
•
Updated
•
2
•
2
RedHatAI/Qwen2.5-14B-Instruct-FP8-dynamic
15B
•
Updated
•
1.37k
RedHatAI/Qwen2.5-72B-Instruct-FP8-dynamic
73B
•
Updated
•
268
RedHatAI/Qwen2.5-Coder-7B-FP8-dynamic
8B
•
Updated
•
1
RedHatAI/Qwen2.5-Coder-7B-Instruct-FP8-dynamic
8B
•
Updated
•
1
RedHatAI/Qwen2.5-Math-7B-FP8-dynamic
8B
•
Updated
•
2
RedHatAI/Qwen2.5-Coder-14B-FP8-dynamic
15B
•
Updated
•
1
RedHatAI/Qwen2.5-Coder-32B-Instruct-FP8-dynamic
33B
•
Updated
•
99
RedHatAI/Qwen2.5-Coder-32B-FP8-dynamic
33B
•
Updated
•
3
RedHatAI/Qwen2.5-Math-72B-Instruct-FP8-dynamic
73B
•
Updated
•
1
RedHatAI/Qwen2.5-Math-72B-FP8-dynamic
73B
•
Updated
•
1
RedHatAI/Qwen2.5-32B-FP8-dynamic
33B
•
Updated
•
1
RedHatAI/Qwen2.5-32B-Instruct-FP8-dynamic
33B
•
Updated
•
1.17k
RedHatAI/Qwen2.5-3B-Instruct-FP8-dynamic
3B
•
Updated
•
8
RedHatAI/Qwen2.5-1.5B-Instruct-FP8-dynamic
2B
•
Updated
•
10