Can you add a Tensorflow compatible model?
#68 opened 2 days ago
by
kgolden317
multilang support
#67 opened 2 days ago
by
ulasarikaya
modernBERT training learning rate=0 and validation_loss=nan
1
#66 opened 8 days ago
by
devals9
LayerNorm.__init__() got an unexpected keyword argument 'bias'
#65 opened 13 days ago
by
clabluo
ModernBert vs Bert for text classification
2
#64 opened 17 days ago
by
Joseph2805
Question about MLDR Evaluation Metrics in ModernBERT Paper
#62 opened 23 days ago
by
WoutDeRijck

I have trained a multilingual version of ModernBert
#60 opened 23 days ago
by
neavo

nan or 0.0 loss when training with flash attention
16
#59 opened 23 days ago
by
roadtoagi

Modernbert with Golang
#58 opened 27 days ago
by
Thibault-Requesty
ModernBERT fails to work without FlashAttention !
3
#56 opened 30 days ago
by
benhachem

Import fails on AWS lamba instance.
4
#55 opened about 1 month ago
by
obeijbom

Performance vs the original architecture on approximate original data sizes (BooksCorpus/Wikipedia)
#54 opened about 1 month ago
by
tollefj
Problem with highly padded sequences
4
#49 opened about 1 month ago
by
fmrs
Speed Benchmarks with MPS Backend
1
#47 opened about 1 month ago
by
mlburnham
Continual pre-training for multilingual support (extend embedding matrix and tokenizer)
1
#46 opened about 2 months ago
by
ibotana

Encountering Error: cannot import name 'shard_checkpoint' from 'transformers.modeling_utils'
1
#44 opened about 2 months ago
by
rkabir
ModernBertModel works on the CPU but fails on the GPU
1
#43 opened about 2 months ago
by
rudigung
ModernBERT-base-chinese
4
#42 opened about 2 months ago
by
ZBW
Error: RuntimeError: Failed to import transformers.models.modernbert.modeling_modernbert because of the following error (look up to see its traceback): Windows not yet supported for torch.compile
5
#40 opened about 2 months ago
by
JoAmps42i
ModernBART wen?
6
#38 opened about 2 months ago
by
Fizzarolli

Pretraining Using HF Tokenizers and Transformers
2
#36 opened about 2 months ago
by
akhooli

Update README.md
1
#35 opened about 2 months ago
by
solankibhargav

Unpadding and Sequence Packing inference example?
2
#34 opened about 2 months ago
by
denti
Interview Request: Thoughts on Model Documentation
#33 opened about 2 months ago
by
evatang
Training Data?
2
#32 opened about 2 months ago
by
binarymax

What is the position of this model in MTEB leaderboard?
3
#31 opened about 2 months ago
by
deepak-banka
tokenizer
1
#24 opened about 2 months ago
by
ulasarikaya
RuntimeError: Failed to import transformers.models.modernbert.modeling_modernbert
2
#21 opened 2 months ago
by
SantoshHF
Pretraining data cutoff?
#17 opened 2 months ago
by
ytsaig
How to use ModernBERT with the AutoModelForQuestionAnswering class?
4
#15 opened 2 months ago
by
sraj
Is ModernBERT already fine-tuned for IR tasks?
4
#13 opened 2 months ago
by
belerico
Question about output embedding vector of ModernBERT
#12 opened 2 months ago
by
Youm9602
ModernBert for multi-vector embeddings
3
#11 opened 2 months ago
by
admarcosai
How to use ModernBERT as a sentence transformer?
30
#9 opened 2 months ago
by
hungrybiker
multilingual
3
#8 opened 2 months ago
by
ale-volpe
Is this model meant for full bfloat16, AMP bfloat16 or no bfloat16?
2
#7 opened 2 months ago
by
umarbutler

# Fine-tuning ModernBERT on a Large Dataset with Masked Language Modelling
1
#6 opened 2 months ago
by
ssmits
Precisions about the config properties wrt the paper
1
#5 opened 2 months ago
by
TomSchelsen
bug: model output logits have detached gradient
#4 opened 2 months ago
by
andersonbcdefg
How to see which version of Transformers library is needed to get access to this model
16
#3 opened 2 months ago
by
aero-artem