GGUFs of This model, tested, and conforms to tensor sizes - IQ4NL, Q5_1, MXFP4_MOE.gguf
#44
by
DavidAU
- opened
Tested and Imatrix'ed ; these take into account current issues with quanting OpenAi model into GGUF format.
Also includes test parameters.
Neo Imatrix GGUFs:
https://huggingface.co/DavidAU/Openai_gpt-oss-20b-NEO-GGUF
DI-Matrix NEO/CODER:
Duel application of Imatrix.
https://huggingface.co/DavidAU/Openai_gpt-oss-20b-CODER-NEO-CODE-DI-MATRIX-GGUF
(some quants still uploading for this repo)
Amazing model with small hallucinations and misinformation (similar to o4-mini). And unfortunately - extremely censored.