6.0bpw?
#1
by
MetaphoricalCode
- opened
Greetings! Just wondering if you have plans for 6.0bpw?
v2.2 was a great experience for me, so I'm looking forward to trying this out. Sadly, I can't quantize the model by myself. Thanks!
3.0 was trash due to dataset problems. GGUFs of 3.4 are going to be up within the hour. If testing goes well on those I'll quant the EXL2 to 6.0bpw for you.
3.0 was trash due to dataset problems. GGUFs of 3.4 are going to be up within the hour. If testing goes well on those I'll quant the EXL2 to 6.0bpw for you.
Gotcha. Appreciate the work! I'll stay tuned and check on Safeword once in a while.
MetaphoricalCode
changed discussion status to
closed