Simontwice commited on
Commit
cd933a1
·
verified ·
1 Parent(s): e8eff38

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -44,7 +44,7 @@ mistral-chat $HOME/mistral_models/mamba-codestral-7B-v0.1 --instruct --max_toke
44
  ```
45
 
46
  ## Evaluation
47
- We evaluate Codestral Mamba, Codestral and open-weight models of the similar size on industry-standard benchmarks.
48
  | Benchmarks | HumanEval | MBPP | Spider | CruxE | HumanEval C++ | HumanEvalJava |HumanEvalJS |HumanEval Bash |
49
  | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
50
  | CodeGemma 1.1 7B | 61.0% | 67.7% | 46.3% | 50.4% | 49.1% | 41.8% | 52.2% | 9.4% |
 
44
  ```
45
 
46
  ## Evaluation
47
+ We evaluate Codestral Mamba and open-weight models of the similar size on industry-standard benchmarks.
48
  | Benchmarks | HumanEval | MBPP | Spider | CruxE | HumanEval C++ | HumanEvalJava |HumanEvalJS |HumanEval Bash |
49
  | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
50
  | CodeGemma 1.1 7B | 61.0% | 67.7% | 46.3% | 50.4% | 49.1% | 41.8% | 52.2% | 9.4% |