It's great
#2
by
annetterunner
- opened
Don't sleep on this model. It's a strong contender for best creative 24B. If you're having issues with repetition or metadata leakage, ensure that you are using the ChatML template. Even at iQ4_XS, this model writes well, keeps track of the context, and remains largely free of GPTisms and other nuisances.
what's the max context it can run?