Prompt Template for use with model

#2
by solotrek - opened

When loading this model into LMStudio, the following error message is seen. Can you please guide me on what the prompt template for this model should contain?

Failed to send message
Error rendering prompt with jinja template: "Error: Parser Error: Expected closing statement token. OpenSquareBracket !== CloseStatement.
.
.
.
This is usually an issue with the model's prompt template. If you are using a popular model, you can try to search the model under lmstudio-community, which will have fixed prompt templates. If you cannot find one, you are welcome to post this issue to our discord or issue tracker on GitHub. Alternatively, if you know how to write jinja templates, you can override the prompt template in My Models > model settings > Prompt Template.

LM Studio Community org

I think an update may be coming for this, but need to confirm

See here, I posted a fixed template: https://huggingface.co/ilintar/THUDM_GLM-Z1-9B-0414_iGGUF

LM Studio takes offense with the chained [function call][indexing] sequence, so you have to split it into two lines.

LM Studio Community org

They say they'll have a fix pushed for the template issue, so you'll just need to update when that arrives!

Sign up or log in to comment