This is broken with Unsloth stable (and the unstable build is broken anyway)
#5 opened 8 days ago
by
Ransom
RAM requirements for running Llama-3.3-70B-Instruct-Q5_K_M.gguf
1
#4 opened about 2 months ago
by
hyadav22
Ollama run command doesn't works
1
#3 opened 2 months ago
by
babakgh
can vllm launch this model?
5
#2 opened 2 months ago
by
chopin1998

It is quant of your own finetuned or original model?
6
#1 opened 3 months ago
by
supercharge19