loubnabnl HF Staff commited on
Commit
6c1f398
·
verified ·
1 Parent(s): 8e09a45

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -151,6 +151,7 @@ Evaluation results of non reasoning models and reasoning models in no thinking m
151
  | Graduate-level reasoning | GPQA Diamond | <u>35.7</u> | 32.2 | 29.4 | 31.8 | **44.4** |
152
  | Instruction following | IFEval | **76.7** | 65.6 | 71.6 | <u>74.0</u> | 68.9 |
153
  | Alignment | MixEval Hard | 26.9 | <u>27.6</u> | 24.9 | 24.3 | **31.6** |
 
154
  | Multilingual Q&A | Global MMLU | <u>53.5</u> | 50.54 | 46.8 | 49.5 | **65.1** |
155
 
156
  ### Extended Thinking
@@ -163,6 +164,7 @@ Evaluation results in reasoning mode for SmolLM3 and Qwen3 models:
163
  | Graduate-level reasoning | GPQA Diamond | <u>41.7</u> | 39.9 | **55.3** |
164
  | Instruction following | IFEval | 71.2 | <u>74.2</u> | **85.4** |
165
  | Alignment | MixEval Hard | 30.8 | <u>33.9</u> | **38.0** |
 
166
  | Multilingual Q&A | Global MMLU | <u>64.1</u> | 62.3 | **73.3** |
167
 
168
  ## Training
 
151
  | Graduate-level reasoning | GPQA Diamond | <u>35.7</u> | 32.2 | 29.4 | 31.8 | **44.4** |
152
  | Instruction following | IFEval | **76.7** | 65.6 | 71.6 | <u>74.0</u> | 68.9 |
153
  | Alignment | MixEval Hard | 26.9 | <u>27.6</u> | 24.9 | 24.3 | **31.6** |
154
+ | Knowledge | MMLU-Pro | 45.0 | 41.9 | 36.6 | <u>45.6</u> | **60.9** |
155
  | Multilingual Q&A | Global MMLU | <u>53.5</u> | 50.54 | 46.8 | 49.5 | **65.1** |
156
 
157
  ### Extended Thinking
 
164
  | Graduate-level reasoning | GPQA Diamond | <u>41.7</u> | 39.9 | **55.3** |
165
  | Instruction following | IFEval | 71.2 | <u>74.2</u> | **85.4** |
166
  | Alignment | MixEval Hard | 30.8 | <u>33.9</u> | **38.0** |
167
+ | Knowledge | MMLU-Pro | <u>58.4</u> | 57.8 | **70.2** |
168
  | Multilingual Q&A | Global MMLU | <u>64.1</u> | 62.3 | **73.3** |
169
 
170
  ## Training