Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models
Paper
•
2501.11873
•
Published
•
63
Tianyi Tang
StevenTang
·
AI & ML interests
NLP
Recent Activity
upvoted
a
paper
about 1 month ago
Demons in the Detail: On Implementing Load Balancing Loss for Training
Specialized Mixture-of-Expert Models
upvoted
a
paper
2 months ago
Qwen2.5 Technical Report
upvoted
a
paper
3 months ago
ProcessBench: Identifying Process Errors in Mathematical Reasoning
Organizations
