Files changed (1) hide show
  1. README.md +45 -33
README.md CHANGED
@@ -1,33 +1,45 @@
1
- ---
2
- base_model:
3
- - Qwen/Qwen2.5-1.5B
4
- language:
5
- - en
6
- library_name: transformers
7
- license: apache-2.0
8
- license_link: https://huggingface.co/Qwen/Qwen2.5-Coder-1.5B/blob/main/LICENSE
9
- pipeline_tag: text-generation
10
- tags:
11
- - code
12
- - qwen
13
- - qwen-coder
14
- - codeqwen
15
- - mlx
16
- ---
17
-
18
- # mlx-community/Qwen2.5-Coder-1.5B-4bit
19
-
20
- The Model [mlx-community/Qwen2.5-Coder-1.5B-4bit](https://huggingface.co/mlx-community/Qwen2.5-Coder-1.5B-4bit) was converted to MLX format from [Qwen/Qwen2.5-Coder-1.5B](https://huggingface.co/Qwen/Qwen2.5-Coder-1.5B) using mlx-lm version **0.18.1**.
21
-
22
- ## Use with mlx
23
-
24
- ```bash
25
- pip install mlx-lm
26
- ```
27
-
28
- ```python
29
- from mlx_lm import load, generate
30
-
31
- model, tokenizer = load("mlx-community/Qwen2.5-Coder-1.5B-4bit")
32
- response = generate(model, tokenizer, prompt="hello", verbose=True)
33
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Qwen/Qwen2.5-1.5B
4
+ language:
5
+ - zho
6
+ - eng
7
+ - fra
8
+ - spa
9
+ - por
10
+ - deu
11
+ - ita
12
+ - rus
13
+ - jpn
14
+ - kor
15
+ - vie
16
+ - tha
17
+ - ara
18
+ library_name: transformers
19
+ license: apache-2.0
20
+ license_link: https://huggingface.co/Qwen/Qwen2.5-Coder-1.5B/blob/main/LICENSE
21
+ pipeline_tag: text-generation
22
+ tags:
23
+ - code
24
+ - qwen
25
+ - qwen-coder
26
+ - codeqwen
27
+ - mlx
28
+ ---
29
+
30
+ # mlx-community/Qwen2.5-Coder-1.5B-4bit
31
+
32
+ The Model [mlx-community/Qwen2.5-Coder-1.5B-4bit](https://huggingface.co/mlx-community/Qwen2.5-Coder-1.5B-4bit) was converted to MLX format from [Qwen/Qwen2.5-Coder-1.5B](https://huggingface.co/Qwen/Qwen2.5-Coder-1.5B) using mlx-lm version **0.18.1**.
33
+
34
+ ## Use with mlx
35
+
36
+ ```bash
37
+ pip install mlx-lm
38
+ ```
39
+
40
+ ```python
41
+ from mlx_lm import load, generate
42
+
43
+ model, tokenizer = load("mlx-community/Qwen2.5-Coder-1.5B-4bit")
44
+ response = generate(model, tokenizer, prompt="hello", verbose=True)
45
+ ```