Add quant links (#3)
Browse files- Add quant links (d14f21bb457449ef979aec9d218ee64139c3b977)
Co-authored-by: Bartowski <[email protected]>
README.md
CHANGED
|
@@ -24,6 +24,12 @@ Hercules-4.0-Mistral-v0.2-7B is a fine-tuned language model derived from Mistral
|
|
| 24 |
- Function Calling: Seamlessly interpreting and executing function calls, providing appropriate input and output values.
|
| 25 |
- Domain-Specific Knowledge: Engaging in informative and educational conversations about Biology, Chemistry, Physics, Mathematics, Medicine, Computer Science, and more.
|
| 26 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
## Intended Uses & Potential Bias
|
| 28 |
|
| 29 |
Hercules-4.0-Mistral-v.02-7B is well-suited to the following applications:
|
|
|
|
| 24 |
- Function Calling: Seamlessly interpreting and executing function calls, providing appropriate input and output values.
|
| 25 |
- Domain-Specific Knowledge: Engaging in informative and educational conversations about Biology, Chemistry, Physics, Mathematics, Medicine, Computer Science, and more.
|
| 26 |
|
| 27 |
+
## Quants
|
| 28 |
+
|
| 29 |
+
GGUF: https://huggingface.co/bartowski/Hercules-4.0-Mistral-v0.2-7B-GGUF
|
| 30 |
+
|
| 31 |
+
ExLlamaV2: https://huggingface.co/bartowski/Hercules-4.0-Mistral-v0.2-7B-exl2
|
| 32 |
+
|
| 33 |
## Intended Uses & Potential Bias
|
| 34 |
|
| 35 |
Hercules-4.0-Mistral-v.02-7B is well-suited to the following applications:
|