GGUF
vllm
mistral-common
conversational
danielhanchen commited on
Commit
b1564b9
·
verified ·
1 Parent(s): e4fa2be

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -5
README.md CHANGED
@@ -36,6 +36,25 @@ tags:
36
  - vllm
37
  - mistral-common
38
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
39
 
40
  # Magistral Small 1.1
41
 
@@ -104,11 +123,6 @@ The model can be used with the following frameworks;
104
  - [`vllm (recommended)`](https://github.com/vllm-project/vllm): See [below](#vllm-recommended)
105
  - [`transformers`](https://github.com/huggingface/transformers): See [below](#transformers)
106
 
107
- ### Training
108
-
109
- Fine-tuning is possible with (*alphabetically sorted*):
110
- - [`axolotl`](https://github.com/axolotl-ai-cloud/axolotl): https://github.com/axolotl-ai-cloud/axolotl/tree/main/examples/magistral
111
-
112
  ### vLLM (recommended)
113
 
114
  We recommend using this model with the [vLLM library](https://github.com/vllm-project/vllm)
 
36
  - vllm
37
  - mistral-common
38
  ---
39
+ <div>
40
+ <p style="margin-bottom: 0; margin-top: 0;">
41
+ <strong>Learn to run Magistral correctly - <a href="https://docs.unsloth.ai/basics/magistral">Read our Guide</a>.</strong>
42
+ </p>
43
+ <p style="margin-top: 0;margin-bottom: 0;">
44
+ <em><a href="https://docs.unsloth.ai/basics/unsloth-dynamic-v2.0-gguf">Unsloth Dynamic 2.0</a> achieves SOTA performance in model quantization.</em>
45
+ </p>
46
+ <div style="display: flex; gap: 5px; align-items: center; ">
47
+ <a href="https://github.com/unslothai/unsloth/">
48
+ <img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
49
+ </a>
50
+ <a href="https://discord.gg/unsloth">
51
+ <img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173">
52
+ </a>
53
+ <a href="https://docs.unsloth.ai/basics/magistral">
54
+ <img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
55
+ </a>
56
+ </div>
57
+ </div>
58
 
59
  # Magistral Small 1.1
60
 
 
123
  - [`vllm (recommended)`](https://github.com/vllm-project/vllm): See [below](#vllm-recommended)
124
  - [`transformers`](https://github.com/huggingface/transformers): See [below](#transformers)
125
 
 
 
 
 
 
126
  ### vLLM (recommended)
127
 
128
  We recommend using this model with the [vLLM library](https://github.com/vllm-project/vllm)