Article
makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch
By
•
•
51Thierry Herrmann
thierryh
AI & ML interests
deep learning, machine learning
Recent Activity
upvoted
an
article
7 days ago
makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch
updated
a model
over 1 year ago
thierryh/ppo-LunarLander-v2
Organizations
None yet
thierryh's activity
upvoted
an
article
7 days ago
upvoted
an
article
8 days ago
Article
From PyTorch DDP to 🤗 Accelerate to 🤗 Trainer, mastery of distributed training with ease
•
23
updated
a
model
over 1 year ago