turboderp
/

Llama-3.1-Nemotron-Ultra-253B-v1-exl3

Model card Files Files and versions Community

turboderp commited on May 30

Commit

c221703

·

verified ·

1 Parent(s): b0ed94f

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -7,5 +7,6 @@ license_link: >-
 EXL3 quants of [Llama-3_1-Nemotron-Ultra-253B-v1](https://huggingface.co/nvidia/Llama-3_1-Nemotron-Ultra-253B-v1)
 [2.00 bits per weight](https://huggingface.co/turboderp/Llama-3.1-Nemotron-Ultra-253B-v1-exl3/tree/2.0bpw)
 (more bitrates will follow)

 EXL3 quants of [Llama-3_1-Nemotron-Ultra-253B-v1](https://huggingface.co/nvidia/Llama-3_1-Nemotron-Ultra-253B-v1)
 [2.00 bits per weight](https://huggingface.co/turboderp/Llama-3.1-Nemotron-Ultra-253B-v1-exl3/tree/2.0bpw)
+[5.00 bits per weight](https://huggingface.co/turboderp/Llama-3.1-Nemotron-Ultra-253B-v1-exl3/tree/5.0bpw)
 (more bitrates will follow)