Granite via local GGUF
📝
Chat with Local GGUF server
Full name
TobDeBer
AI & ML interests
Diffusion, Causality, LLM, LMM (Large Music Model), Quantization, AI Context Databases
Recent Activity
published
a Space
3 days ago
TobDeBer/gguf-local-server
updated
a Space
3 days ago
TobDeBer/gguf-local-server
new activity
9 days ago
unsloth/DeepSeek-R1-GGUF:Accuracy of the dynamic quants compared to usual quants?
Organizations
None yet
TobDeBer's activity
published
a
Space
3 days ago
updated
a
Space
3 days ago
Accuracy of the dynamic quants compared to usual quants?
19
#21 opened 16 days ago
by
inputout
Saving to q5_k_m GGUF
4
#1 opened 11 days ago
by
sasha1234567
8bits quantization
5
#20 opened 17 days ago
by
ramkumarkoppu
updated
a
model
16 days ago
updated
a
collection
20 days ago
liked
a
Space
20 days ago
Is there a model removing non-shared MoE experts?
4
#17 opened 23 days ago
by
ghostplant
updated
a
collection
22 days ago
liked
a
Space
22 days ago
updated
a
collection
22 days ago
liked
a
Space
22 days ago
Over 2 tok/sec agg backed by NVMe SSD on 96GB RAM + 24GB VRAM AM5 rig with llama.cpp
9
#13 opened 25 days ago
by
ubergarm
Quantizer Tool
2
#14 opened 24 days ago
by
TobDeBer
Where did the BF16 come from?
8
#10 opened 25 days ago
by
gshpychka
liked
a
Space
27 days ago
updated
a
collection
27 days ago
liked
a
Space
27 days ago
updated
a
collection
27 days ago