Lewdiculous
/

SOVL_Llama3_8B-GGUF-IQ-Imatrix

Inference Endpoints

Model card Files Files and versions Community

Lewdiculous commited on Apr 30, 2024

Commit

8cf2dd9

·

verified ·

1 Parent(s): c40f9c4

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -7,7 +7,8 @@ GGUF-IQ-Imatrix quants for @jeiku's [ResplendentAI/SOVL_Llama3_8B](https://huggi
 > [!IMPORTANT]
 > **Updated!**
-> These quants have been redone with the fixes from [llama.cpp/pull/6920](https://github.com/ggerganov/llama.cpp/pull/6920) in mind.
 > [!NOTE]
 > **Well...!** <br>

 > [!IMPORTANT]
 > **Updated!**
+> These quants have been redone with the fixes from [llama.cpp/pull/6920](https://github.com/ggerganov/llama.cpp/pull/6920) in mind. <br>
+> Use **KoboldCpp version 1.64** or higher.
 > [!NOTE]
 > **Well...!** <br>