Update README.md
Browse files
README.md
CHANGED
|
@@ -87,7 +87,7 @@ The model is in `ctranslate2` format, and the tokenizers are `sentencepiece`, so
|
|
| 87 |
|
| 88 |
## Metrics
|
| 89 |
|
| 90 |
-
`bleu` and `chrf2` are calculated with [sacrebleu](https://github.com/mjpost/sacrebleu) on the [Flores200 `devtest` test set](https://huggingface.co/datasets/facebook/flores) ("
|
| 91 |
|
| 92 |
|
| 93 |
| | bleu | chrf2 | comet22 | Time (s) |
|
|
|
|
| 87 |
|
| 88 |
## Metrics
|
| 89 |
|
| 90 |
+
`bleu` and `chrf2` are calculated with [sacrebleu](https://github.com/mjpost/sacrebleu) on the [Flores200 `devtest` test set](https://huggingface.co/datasets/facebook/flores) ("eng_Latn"->"ara_Arab"). `comet22` with the [`comet`](https://github.com/Unbabel/COMET) library and the [default model](https://huggingface.co/Unbabel/wmt22-comet-da). "Time (s)" is the time in seconds to translate (using `ctranslate2`) the flores-devtest dataset (1012 sentences) on an RTX 4070s GPU with batch size 32 (faster speed is possible using a large batch size).
|
| 91 |
|
| 92 |
|
| 93 |
| | bleu | chrf2 | comet22 | Time (s) |
|