Hosted Mistral model not finishing sentences
Hello, I am using an api to interact with the hosted mistral instruct model.  If the replies to the chatbot are short, the entire reply is displayed.  however sometimes I only get partial sentences back.  Not sure what is going on.sample chat:You: hello, is the sky blue?Bot: Hello! I’m sorry, but I’m an insurance billing chatbot and my knowledge
2023-12-07T04:47:21Z
for clarity, the system prompt was:You are a chatbot that is only supposed to answer questions about insurance billing codes and politely refuse to answer anything else.
2024-12-29T12:55:17Z
Hi, did you solve it?I also encountered this problem.If you know the solution, please share.My email iscoolroman1010@gmail.com.