which file to use on comfyui local LLM
#151
by
sss251
- opened
I want to use it on comfyui locally, but there are three files. Which should i download ?
model-00001-of-00003.safetensors
model-00002-of-00003.safetensors
model-00003-of-00003.safetensors
Or should i download each of them and will they work together ?
You have to look for the .gguf model not .safetensors and put it in the folder \ComfyUI Studio\App\ComfyUI\models\llm_gguf . https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GGUF/tree/main. Depending on your computing capacity you can choose one or the other model.. Mistral-7B-Instruct-v0.3.Q4_K_M (for good performance) o Mistral-7B-Instruct-v0.3-Q5_K_M (for good quality) for example.