zpn commited on
Commit
788f9af
·
1 Parent(s): 46629ec

fix: readme with perf

Browse files
Files changed (1) hide show
  1. README.md +9 -1
README.md CHANGED
@@ -2898,12 +2898,20 @@ language:
2898
  base_model:
2899
  - answerdotai/ModernBERT-base
2900
  ---
2901
- ---
2902
 
2903
  # ModernBert-Embed-Unsupervised
2904
 
2905
  `modernbert-embed-unsupervised` is the unsupervised checkpoint trained with the [contrastors](https://github.com/nomic-ai/contrastors) library
2906
  for 1 epoch over the 235M weakly-supervised contrastive pairs curated in [Nomic Embed](https://arxiv.org/abs/2402.01613).
2907
 
 
 
 
 
 
2908
 
 
 
 
 
2909
 
 
2898
  base_model:
2899
  - answerdotai/ModernBERT-base
2900
  ---
 
2901
 
2902
  # ModernBert-Embed-Unsupervised
2903
 
2904
  `modernbert-embed-unsupervised` is the unsupervised checkpoint trained with the [contrastors](https://github.com/nomic-ai/contrastors) library
2905
  for 1 epoch over the 235M weakly-supervised contrastive pairs curated in [Nomic Embed](https://arxiv.org/abs/2402.01613).
2906
 
2907
+ We suggest using [moderbert-embed](https://huggingface.co/nomic-ai/modernbert-embed) for embedding tasks.
2908
+
2909
+ ## Performance
2910
+
2911
+ The modernbert-unsupervised model performs similarly to the `nomic-embed-text-v1_unsup` model
2912
 
2913
+ | Model | Average (56) | Classification (12) | Clustering (11) | Pair Classification (3) | Reranking (4) | Retrieval (15) | STS (10) | Overall |
2914
+ |-------|--------------|--------------------:|-----------------|------------------------|---------------|----------------|-----------|----------|
2915
+ | nomic-embed-text-v1_unsup | 59.9 | 71.2 | 42.5 | 83.7 | 55.0 | 48.0 | 80.8 | 30.7 |
2916
+ | modernbert-embed-unsupervised | 60.03 | 72.11 | 44.34 | 82.78 | 55.0 | 47.05 | 80.33 | 31.2 |
2917