TheBloke/Falcon-180B-GGUF
Updated
•
15
•
20
Scotch & SOTA 🥃 Pt. 2: Quantized Small Boi LLM 👉👈
Run on potato, sir. GGUF & GPTQ are good friends.
Note ~~~ imagine ~~~
TheBloke/Llama-2-13B-chat-GPTQ
Text Generation • Updated • 17k • 362Note Probably the go-to for chat on a GPU rig
TheBloke/CodeLlama-34B-GPTQ
Text Generation • Updated • 117 • 20Note Probably the go-to for code on a GPU rig
-
TheBloke/COTHuginn-4.5-19B-GGUF
Updated • 214 • 7 -
TheBloke/Pygmalion-2-13B-GGUF
Text Generation • Updated • 1.97k • 28
TheBloke/Nous-Hermes-13B-Code-GGUF
Updated • 351 • 8Note nous hermes has been particularly good to me locally
TheBloke/MythoMax-L2-Kimiko-v2-13B-GPTQ
Text Generation • Updated • 82 • 23Note this one has some big fans 🪭
-
TheBloke/Airoboros-L2-70b-2.2-GGUF
Updated • 495 • 13
TheBloke/Spicyboros-70B-2.2-GGUF
Updated • 238 • 21Note toxic
TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ
Text Generation • Updated • 1.03k • 576Note toxic
-
mistralai/Mistral-7B-v0.1
Text Generation • Updated • 363k • 3.59k