shimmyshimmer commited on
Commit
e94a1c7
·
verified ·
1 Parent(s): 3083b08

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -4
README.md CHANGED
@@ -10,11 +10,27 @@ tags:
10
  - transformers
11
  ---
12
 
13
- ## ***See [our collection](https://huggingface.co/collections/unsloth/deepseek-r1-all-versions-678e1c48f5d2fce87892ace5) for versions of Deepseek-R1 including GGUF & 4-bit formats.***
14
- *Unsloth's DeepSeek-R1 [1.58-bit + 2-bit Dynamic Quants](https://unsloth.ai/blog/deepseekr1-dynamic) selectively avoids quantizing certain parameters, greatly increasing accuracy than standard 1-bit/2-bit.*
15
- <br>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
 
17
- ## Instructions to run this model in llama.cpp:
18
  Or you can view more detailed instructions here: [unsloth.ai/blog/deepseekr1-dynamic](https://unsloth.ai/blog/deepseekr1-dynamic)
19
  1. Do not forget about `<|User|>` and `<|Assistant|>` tokens! - Or use a chat template formatter
20
  2. Obtain the latest `llama.cpp` at https://github.com/ggerganov/llama.cpp. You can follow the build instructions below as well:
 
10
  - transformers
11
  ---
12
 
13
+ <div>
14
+ <p style="margin-bottom: 0;">
15
+ <strong>See <a href="https://huggingface.co/collections/unsloth/deepseek-r1-all-versions-678e1c48f5d2fce87892ace5">our collection</a> for versions of Deepseek-R1 including GGUF & 4-bit formats.</strong>
16
+ </p>
17
+ <p style="margin-bottom: 0;">
18
+ <em>Unsloth's DeepSeek-R1 <a href="https://unsloth.ai/blog/deepseekr1-dynamic">1.58-bit + 2-bit Dynamic Quants</a> is selectively quantized, greatly improving accuracy over standard 1-bit/2-bit.</em>
19
+ </p>
20
+ <div style="display: flex; gap: 5px; align-items: center; ">
21
+ <a href="https://github.com/unslothai/unsloth/">
22
+ <img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
23
+ </a>
24
+ <a href="https://discord.gg/unsloth">
25
+ <img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173">
26
+ </a>
27
+ <a href="https://docs.unsloth.ai">
28
+ <img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
29
+ </a>
30
+ </div>
31
+ <h1 style="margin-top: 0rem;">Instructions to run this model in llama.cpp:</h2>
32
+ </div>
33
 
 
34
  Or you can view more detailed instructions here: [unsloth.ai/blog/deepseekr1-dynamic](https://unsloth.ai/blog/deepseekr1-dynamic)
35
  1. Do not forget about `<|User|>` and `<|Assistant|>` tokens! - Or use a chat template formatter
36
  2. Obtain the latest `llama.cpp` at https://github.com/ggerganov/llama.cpp. You can follow the build instructions below as well: