1.41k
The Ultra-Scale Playbook
🌌
The ultimate guide to training LLM on large GPU Clusters
Christopher Clive Bonnett PRO
cbonnett
AI & ML interests
None yet
Recent Activity
liked
a Space
4 days ago
nanotron/ultrascale-playbook
updated
a collection
13 days ago
intersting spaces
upvoted
a
paper
13 days ago
The Matrix Calculus You Need For Deep Learning
Organizations
cbonnett's activity
liked
a
Space
4 days ago
updated
a
collection
13 days ago
upvoted
a
paper
13 days ago
liked
a
Space
15 days ago
upvoted
an
article
about 1 month ago
Article
Finally, a Replacement for BERT: Introducing ModernBERT
•
554
commented on
Finally, a Replacement for BERT: Introducing ModernBERT
about 1 month ago
Loved it, thanks for having done the work, explained it and provided the new BERT model.
I was wondering how much you would gain over ModernBERT-Base by distilling ModernBERT-Large back into a ModernBERT-Base sized model. Any ideas if that is worth doing ?
updated
a
collection
about 1 year ago
liked
a
Space
over 1 year ago