Mistral Small?
#1
by
MrDevolver
- opened
Hey, this is a surprisingly good model.
Could you please consider doing the same model but with Mistral Small 24B as a base?
The reason is that unfortunately this 28B model is too slow for my hardware. I suspect it's due to the number of layers which is way too big for a model of that size, so technically it's like trying to load a model of much bigger size than what I can realistically run on my hardware, but from what I've seen the output is roughly on par with Mistral Small 24B, so maybe doing the same with that 24B model as a base wouldn't be too far fetched.