Update README.md
Browse files
README.md
CHANGED
@@ -36,6 +36,25 @@ tags:
|
|
36 |
- vllm
|
37 |
- mistral-common
|
38 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
39 |
|
40 |
# Magistral Small 1.1
|
41 |
|
@@ -104,11 +123,6 @@ The model can be used with the following frameworks;
|
|
104 |
- [`vllm (recommended)`](https://github.com/vllm-project/vllm): See [below](#vllm-recommended)
|
105 |
- [`transformers`](https://github.com/huggingface/transformers): See [below](#transformers)
|
106 |
|
107 |
-
### Training
|
108 |
-
|
109 |
-
Fine-tuning is possible with (*alphabetically sorted*):
|
110 |
-
- [`axolotl`](https://github.com/axolotl-ai-cloud/axolotl): https://github.com/axolotl-ai-cloud/axolotl/tree/main/examples/magistral
|
111 |
-
|
112 |
### vLLM (recommended)
|
113 |
|
114 |
We recommend using this model with the [vLLM library](https://github.com/vllm-project/vllm)
|
|
|
36 |
- vllm
|
37 |
- mistral-common
|
38 |
---
|
39 |
+
<div>
|
40 |
+
<p style="margin-bottom: 0; margin-top: 0;">
|
41 |
+
<strong>Learn to run Magistral correctly - <a href="https://docs.unsloth.ai/basics/magistral">Read our Guide</a>.</strong>
|
42 |
+
</p>
|
43 |
+
<p style="margin-top: 0;margin-bottom: 0;">
|
44 |
+
<em><a href="https://docs.unsloth.ai/basics/unsloth-dynamic-v2.0-gguf">Unsloth Dynamic 2.0</a> achieves SOTA performance in model quantization.</em>
|
45 |
+
</p>
|
46 |
+
<div style="display: flex; gap: 5px; align-items: center; ">
|
47 |
+
<a href="https://github.com/unslothai/unsloth/">
|
48 |
+
<img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
|
49 |
+
</a>
|
50 |
+
<a href="https://discord.gg/unsloth">
|
51 |
+
<img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173">
|
52 |
+
</a>
|
53 |
+
<a href="https://docs.unsloth.ai/basics/magistral">
|
54 |
+
<img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
|
55 |
+
</a>
|
56 |
+
</div>
|
57 |
+
</div>
|
58 |
|
59 |
# Magistral Small 1.1
|
60 |
|
|
|
123 |
- [`vllm (recommended)`](https://github.com/vllm-project/vllm): See [below](#vllm-recommended)
|
124 |
- [`transformers`](https://github.com/huggingface/transformers): See [below](#transformers)
|
125 |
|
|
|
|
|
|
|
|
|
|
|
126 |
### vLLM (recommended)
|
127 |
|
128 |
We recommend using this model with the [vLLM library](https://github.com/vllm-project/vllm)
|