GGUF LoRA adapters - a ggml-org Collection

ggml-org 's Collections

llama.cpp presets

GGUF LoRA adapters

Gemma 1.1 GGUFs

GGUF LoRA adapters

updated about 1 month ago

Adapters extracted from fine tuned models, using mergekit-extract-lora

ggml-org/LoRA-Llama-3-Instruct-abliteration-8B-F16-GGUF

Updated Nov 1, 2024 • 44 • 1
ggml-org/LoRA-Qwen2.5-1.5B-Instruct-abliterated-F16-GGUF

Updated about 1 month ago • 175 • 2
ggml-org/LoRA-Qwen2.5-3B-Instruct-abliterated-F16-GGUF

Updated Jan 9 • 55 • 1
ggml-org/LoRA-Qwen2.5-7B-Instruct-abliterated-v3-F16-GGUF

Updated Jan 8 • 176 • 3
ggml-org/LoRA-Qwen2.5-14B-Instruct-abliterated-v2-F16-GGUF

Updated Jan 8 • 71 • 1
ggml-org/LoRA-Qwen2.5-32B-Instruct-abliterated-F16-GGUF

Updated Jan 9 • 240 • 4
ggml-org/LoRA-Qwen2.5-72B-Instruct-abliterated-F16-GGUF

Updated Jan 22 • 43
ggml-org/LoRA-llama-3-70B-Instruct-abliterated-F16-GGUF

Updated Jan 22 • 47
ggml-org/LoRA-phi-4-abliterated-F16-GGUF

Updated Jan 9 • 243 • 2

Note --- Reasoning models (may need special system message):
ggml-org/LoRA-SmallThinker-3B-Preview-F16-GGUF

Updated Jan 9 • 37
ggml-org/LoRA-Deepthink-Reasoning-7B-F16-GGUF

Updated Jan 8 • 108
ggml-org/LoRA-Deepthink-Reasoning-Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Jan 15 • 30
ggml-org/LoRA-Llama-3.1-8B-MultiReflection-F16-GGUF

Updated Jan 8 • 25

Note --- Other models:
ggml-org/LoRA-Qwen2.5-Coder-7B-Instruct-F16-GGUF

Updated Jan 8 • 44
ggml-org/LoRA-Human-Like-Qwen2.5-7B-Instruct-F16-GGUF

Updated Jan 8 • 23
ggml-org/LoRA-Qwerus-Qwen2.5-7B-Instruct-F16-GGUF

Updated Jan 8 • 21