fix: readme with perf
Browse files
README.md
CHANGED
@@ -2898,12 +2898,20 @@ language:
|
|
2898 |
base_model:
|
2899 |
- answerdotai/ModernBERT-base
|
2900 |
---
|
2901 |
-
---
|
2902 |
|
2903 |
# ModernBert-Embed-Unsupervised
|
2904 |
|
2905 |
`modernbert-embed-unsupervised` is the unsupervised checkpoint trained with the [contrastors](https://github.com/nomic-ai/contrastors) library
|
2906 |
for 1 epoch over the 235M weakly-supervised contrastive pairs curated in [Nomic Embed](https://arxiv.org/abs/2402.01613).
|
2907 |
|
|
|
|
|
|
|
|
|
|
|
2908 |
|
|
|
|
|
|
|
|
|
2909 |
|
|
|
2898 |
base_model:
|
2899 |
- answerdotai/ModernBERT-base
|
2900 |
---
|
|
|
2901 |
|
2902 |
# ModernBert-Embed-Unsupervised
|
2903 |
|
2904 |
`modernbert-embed-unsupervised` is the unsupervised checkpoint trained with the [contrastors](https://github.com/nomic-ai/contrastors) library
|
2905 |
for 1 epoch over the 235M weakly-supervised contrastive pairs curated in [Nomic Embed](https://arxiv.org/abs/2402.01613).
|
2906 |
|
2907 |
+
We suggest using [moderbert-embed](https://huggingface.co/nomic-ai/modernbert-embed) for embedding tasks.
|
2908 |
+
|
2909 |
+
## Performance
|
2910 |
+
|
2911 |
+
The modernbert-unsupervised model performs similarly to the `nomic-embed-text-v1_unsup` model
|
2912 |
|
2913 |
+
| Model | Average (56) | Classification (12) | Clustering (11) | Pair Classification (3) | Reranking (4) | Retrieval (15) | STS (10) | Overall |
|
2914 |
+
|-------|--------------|--------------------:|-----------------|------------------------|---------------|----------------|-----------|----------|
|
2915 |
+
| nomic-embed-text-v1_unsup | 59.9 | 71.2 | 42.5 | 83.7 | 55.0 | 48.0 | 80.8 | 30.7 |
|
2916 |
+
| modernbert-embed-unsupervised | 60.03 | 72.11 | 44.34 | 82.78 | 55.0 | 47.05 | 80.33 | 31.2 |
|
2917 |
|