Update README.md
Browse files
README.md
CHANGED
@@ -151,6 +151,7 @@ Evaluation results of non reasoning models and reasoning models in no thinking m
|
|
151 |
| Graduate-level reasoning | GPQA Diamond | <u>35.7</u> | 32.2 | 29.4 | 31.8 | **44.4** |
|
152 |
| Instruction following | IFEval | **76.7** | 65.6 | 71.6 | <u>74.0</u> | 68.9 |
|
153 |
| Alignment | MixEval Hard | 26.9 | <u>27.6</u> | 24.9 | 24.3 | **31.6** |
|
|
|
154 |
| Multilingual Q&A | Global MMLU | <u>53.5</u> | 50.54 | 46.8 | 49.5 | **65.1** |
|
155 |
|
156 |
### Extended Thinking
|
@@ -163,6 +164,7 @@ Evaluation results in reasoning mode for SmolLM3 and Qwen3 models:
|
|
163 |
| Graduate-level reasoning | GPQA Diamond | <u>41.7</u> | 39.9 | **55.3** |
|
164 |
| Instruction following | IFEval | 71.2 | <u>74.2</u> | **85.4** |
|
165 |
| Alignment | MixEval Hard | 30.8 | <u>33.9</u> | **38.0** |
|
|
|
166 |
| Multilingual Q&A | Global MMLU | <u>64.1</u> | 62.3 | **73.3** |
|
167 |
|
168 |
## Training
|
|
|
151 |
| Graduate-level reasoning | GPQA Diamond | <u>35.7</u> | 32.2 | 29.4 | 31.8 | **44.4** |
|
152 |
| Instruction following | IFEval | **76.7** | 65.6 | 71.6 | <u>74.0</u> | 68.9 |
|
153 |
| Alignment | MixEval Hard | 26.9 | <u>27.6</u> | 24.9 | 24.3 | **31.6** |
|
154 |
+
| Knowledge | MMLU-Pro | 45.0 | 41.9 | 36.6 | <u>45.6</u> | **60.9** |
|
155 |
| Multilingual Q&A | Global MMLU | <u>53.5</u> | 50.54 | 46.8 | 49.5 | **65.1** |
|
156 |
|
157 |
### Extended Thinking
|
|
|
164 |
| Graduate-level reasoning | GPQA Diamond | <u>41.7</u> | 39.9 | **55.3** |
|
165 |
| Instruction following | IFEval | 71.2 | <u>74.2</u> | **85.4** |
|
166 |
| Alignment | MixEval Hard | 30.8 | <u>33.9</u> | **38.0** |
|
167 |
+
| Knowledge | MMLU-Pro | <u>58.4</u> | 57.8 | **70.2** |
|
168 |
| Multilingual Q&A | Global MMLU | <u>64.1</u> | 62.3 | **73.3** |
|
169 |
|
170 |
## Training
|