Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers
Paper
•
2406.16450
•
Published
Skander Moalla
skandermoalla
·
AI & ML interests
DeepRL, RL finetuning
Recent Activity
authored
a paper
2 days ago
Building on Efficient Foundations: Effectively Training LLMs with
Structured Feedforward Layers
authored
a paper
2 days ago
Apertus: Democratizing Open and Compliant LLMs for Global Language
Environments
authored
a paper
2 days ago
Quantile Reward Policy Optimization: Alignment with Pointwise Regression and Exact Partition Functions
Organizations
