How do I run this model
Hi there, I’ve recently installed Llama with GPT4ALL and I know how to load single bin files into it but I recently came across this model which I want to try but it has two bin files.In the past when I have tried models which use two or morebinfiles, they never seem to work in GPT4ALL / Llama and I’m completely confused.This is the model I want to try out… I assume I can use Llama.cpp to run it?  I am very confused.  Help!!!https://huggingface.co/mosaicml/mpt-7b-storywriter/discussions/14This is my llama run.bat filetitle llama.cpp:startset GPU=1main -i --interactive-first -t 8 -r “### Human:” --temp 0 -c 2048 -n -1 --ignore-eos --repeat_penalty 1.2 --instruct -m ggml-vic13b-uncensored-q5_1.binpausegoto start
2023-11-07T12:54:05Z
I have the same problem. I dont understand how to use llama.cpp with 2 bin files. Im using falcon-7b