It's great

#2
by annetterunner - opened

Don't sleep on this model. It's a strong contender for best creative 24B. If you're having issues with repetition or metadata leakage, ensure that you are using the ChatML template. Even at iQ4_XS, this model writes well, keeps track of the context, and remains largely free of GPTisms and other nuisances.

what's the max context it can run?

Sign up or log in to comment