MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF Text Generation • 71B • Updated Jul 29, 2024 • 161k • 39
unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit Text Generation • 37B • Updated Nov 22, 2024 • 3.6k • 31
legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF Text Generation • 71B • Updated Jul 27, 2024 • 449 • 11
RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8-dynamic Text Generation • 71B • Updated Oct 19, 2024 • 1.27k • 7
lmstudio-community/Meta-Llama-3.1-70B-Instruct-GGUF Text Generation • 71B • Updated Jul 28, 2024 • 570 • 36
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 Text Generation • 19B • Updated Oct 9, 2024 • 955 • 5
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 Text Generation • 71B • Updated Feb 11 • 15.6k • 21
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16 Text Generation • 11B • Updated Feb 12 • 11.6k • 32