Edit Models filters

Model Tree

meta-llama/Llama-3.1-70B

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

61

Full-text search

Active filters: meta-llama/Llama-3.1-70B

FriendliAI/Meta-Llama-3.1-70B-Instruct-int8

Text Generation • Updated Sep 9, 2024 • 17

ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16

Text Generation • Updated Sep 14, 2024 • 41 • 17

mav23/Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Oct 3, 2024 • 4

medmekk/Llama-3.1-70B-torchao-int8_weight_only

Updated Oct 8, 2024

mav23/OpenMath2-Llama3.1-70B-GGUF

Updated Oct 27, 2024 • 154

mav23/Hermes-3-Llama-3.1-70B-GGUF

Updated Nov 4, 2024 • 34

osllmai-community/Hermes-3-Llama-3.1-70B-bnb-4bit

Text Generation • Updated about 1 month ago • 13

MikeRoz/meta-llama_Llama-3.3-70B-Instruct-4.25bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 6 • 1

matatonic/Llama-3.3-70B-Instruct-6.5bpw-h8-exl2.2.3

Text Generation • Updated Dec 6, 2024 • 10

LoneStriker/Llama-3.3-70B-Instruct-2.4bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 15 • 1

LoneStriker/Llama-3.3-70B-Instruct-3.5bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 11 • 2

LoneStriker/Llama-3.3-70B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 19 • 1

LoneStriker/Llama-3.3-70B-Instruct-4.65bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 13 • 3

LoneStriker/Llama-3.3-70B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 11 • 3

LoneStriker/Llama-3.3-70B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Dec 7, 2024 • 24 • 2

MikeRoz/meta-llama_Llama-3.3-70B-Instruct-8.0bpw-h8-exl2

Text Generation • Updated Dec 7, 2024 • 37 • 1

LoneStriker/Llama-3.3-70B-Instruct-2.25bpw-h6-exl2

Text Generation • Updated Dec 7, 2024 • 34 • 1

osllmai-community/Llama-3.3-70B-Instruct-GGUF

Updated about 1 month ago • 74

ThomasBaruzier/Llama-3.3-70B-Instruct-GGUF

Updated 1 day ago • 3.4k • 1

roleplaiapp/Llama-3.3-70B-Instruct-Q3_K_S-GGUF

Text Generation • Updated Jan 15 • 20

roleplaiapp/Llama-3.3-70B-Instruct-Q3_K_M-GGUF

Text Generation • Updated Jan 15 • 27

roleplaiapp/Llama-3.3-70B-Instruct-Q2_K-GGUF

Text Generation • Updated Jan 15 • 35

roleplaiapp/Llama-3.3-70B-Instruct-Q3_K_L-GGUF

Text Generation • Updated Jan 15 • 31

roleplaiapp/Llama-3.3-70B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Jan 15 • 12

roleplaiapp/Llama-3.3-70B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jan 15 • 42

roleplaiapp/Llama-3.3-70B-Instruct-Q5_0-GGUF

Text Generation • Updated Jan 16 • 9

roleplaiapp/Llama-3.3-70B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Jan 16 • 18

roleplaiapp/Llama-3.3-70B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Jan 16 • 20

roleplaiapp/Llama-3.3-70B-Instruct-Q6_K-GGUF

Text Generation • Updated Jan 16 • 43

roleplaiapp/Llama-3.3-70B-Instruct-Q8_0-GGUF

Text Generation • Updated Jan 16 • 22