ModernBERT - a answerdotai Collection

answerdotai 's Collections

CLA-Experiments

Multi-Vector Retrievers

Quantized-FT-Orca-Math

Quantized-LLama-3

Japanese Retrieval

Function Calling

ModernBERT

updated Dec 19, 2024

Bringing BERT into modernity via both architecture changes and scaling

answerdotai/ModernBERT-base

Fill-Mask • 0.1B • Updated Jan 15, 2025 • 843k • 991
answerdotai/ModernBERT-large

Fill-Mask • 0.4B • Updated Jan 15, 2025 • 133k • 450
Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference

Paper • 2412.13663 • Published Dec 18, 2024 • 159