MiniPLM - a MiniLLM Collection

MiniLLM 's Collections

MiniPLM

MiniLLM

MiniPLM

updated Oct 21, 2024

Pre-trained models in MiniPLM: Knowledge Distillation for Pre-Training Language Models

MiniLLM/MiniPLM-Qwen-200M

Text Generation • 0.2B • Updated Oct 27, 2024 • 67 • 9
MiniLLM/MiniPLM-Qwen-500M

Text Generation • 0.5B • Updated Mar 25, 2025 • 13 • 7
MiniLLM/MiniPLM-Qwen-1.2B

Text Generation • 1B • Updated Mar 25, 2025 • 13 • 4
MiniLLM/MiniPLM-Mamba-130M

Text Generation • 0.1B • Updated Mar 25, 2025 • 38 • 3
MiniLLM/MiniPLM-llama3.1-212M

Text Generation • 0.2B • Updated Mar 25, 2025 • 13 • 6