Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
danielhanchen 
posted an update 9 days ago

How bad is the precision loss on the Q2_K_XL quants? I can run that with full GPU offload but I usually dont run lower than Q4, broadly.