Update README.md
Browse files
README.md
CHANGED
@@ -10,11 +10,27 @@ tags:
|
|
10 |
- transformers
|
11 |
---
|
12 |
|
13 |
-
|
14 |
-
|
15 |
-
<
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
16 |
|
17 |
-
## Instructions to run this model in llama.cpp:
|
18 |
Or you can view more detailed instructions here: [unsloth.ai/blog/deepseekr1-dynamic](https://unsloth.ai/blog/deepseekr1-dynamic)
|
19 |
1. Do not forget about `<|User|>` and `<|Assistant|>` tokens! - Or use a chat template formatter
|
20 |
2. Obtain the latest `llama.cpp` at https://github.com/ggerganov/llama.cpp. You can follow the build instructions below as well:
|
|
|
10 |
- transformers
|
11 |
---
|
12 |
|
13 |
+
<div>
|
14 |
+
<p style="margin-bottom: 0;">
|
15 |
+
<strong>See <a href="https://huggingface.co/collections/unsloth/deepseek-r1-all-versions-678e1c48f5d2fce87892ace5">our collection</a> for versions of Deepseek-R1 including GGUF & 4-bit formats.</strong>
|
16 |
+
</p>
|
17 |
+
<p style="margin-bottom: 0;">
|
18 |
+
<em>Unsloth's DeepSeek-R1 <a href="https://unsloth.ai/blog/deepseekr1-dynamic">1.58-bit + 2-bit Dynamic Quants</a> is selectively quantized, greatly improving accuracy over standard 1-bit/2-bit.</em>
|
19 |
+
</p>
|
20 |
+
<div style="display: flex; gap: 5px; align-items: center; ">
|
21 |
+
<a href="https://github.com/unslothai/unsloth/">
|
22 |
+
<img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
|
23 |
+
</a>
|
24 |
+
<a href="https://discord.gg/unsloth">
|
25 |
+
<img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173">
|
26 |
+
</a>
|
27 |
+
<a href="https://docs.unsloth.ai">
|
28 |
+
<img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
|
29 |
+
</a>
|
30 |
+
</div>
|
31 |
+
<h1 style="margin-top: 0rem;">Instructions to run this model in llama.cpp:</h2>
|
32 |
+
</div>
|
33 |
|
|
|
34 |
Or you can view more detailed instructions here: [unsloth.ai/blog/deepseekr1-dynamic](https://unsloth.ai/blog/deepseekr1-dynamic)
|
35 |
1. Do not forget about `<|User|>` and `<|Assistant|>` tokens! - Or use a chat template formatter
|
36 |
2. Obtain the latest `llama.cpp` at https://github.com/ggerganov/llama.cpp. You can follow the build instructions below as well:
|