Update README.md
Browse files
README.md
CHANGED
@@ -5,9 +5,9 @@ base_model:
|
|
5 |
pipeline_tag: text-generation
|
6 |
---
|
7 |
|
8 |
-
# zletpm/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-4.5bit
|
9 |
|
10 |
-
This model [zletpm/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-4.5bit](https://huggingface.co/mlx-community/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-4.5bit) was
|
11 |
converted to MLX format from [anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only](https://huggingface.co/anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only)
|
12 |
using mlx-lm version **0.25.2**.
|
13 |
|
@@ -20,7 +20,7 @@ pip install mlx-lm
|
|
20 |
```python
|
21 |
from mlx_lm import load, generate
|
22 |
|
23 |
-
model, tokenizer = load("zletpm/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-4.5bit")
|
24 |
|
25 |
prompt = "hello"
|
26 |
|
|
|
5 |
pipeline_tag: text-generation
|
6 |
---
|
7 |
|
8 |
+
# zletpm/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-MLX-4.5bit
|
9 |
|
10 |
+
This model [zletpm/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-MLX-4.5bit](https://huggingface.co/mlx-community/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-4.5bit) was
|
11 |
converted to MLX format from [anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only](https://huggingface.co/anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only)
|
12 |
using mlx-lm version **0.25.2**.
|
13 |
|
|
|
20 |
```python
|
21 |
from mlx_lm import load, generate
|
22 |
|
23 |
+
model, tokenizer = load("zletpm/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-MLX-4.5bit")
|
24 |
|
25 |
prompt = "hello"
|
26 |
|