Foundation Text-Generation Models Below 360M Parameters
Great candidates for fine-tuning targeting Wllama and Transformers.js for mobile devices, ordered by number of parameters.
Text Generation • 0.4B • Updated • 210k • 123Note License: apache-2.0 Context Length: 8k
facebook/MobileLLM-R1-360M-base
Text Generation • 0.4B • Updated • 118 • 14Note License: fair-noncommercial-research Context Length: 4k
LiquidAI/LFM2.5-350M-Base
Text Generation • 0.4B • Updated • 9.5k • 31Note License: lfm1.0 Context Length: 32k
PleIAs/Pleias-350m-Preview
0.4B • Updated • 5.65k • 27Note License: apache-2.0 Context Length: 2k
OuteAI/Lite-Oute-1-300M
Text Generation • 0.3B • Updated • 36k • 9Note License: apache-2.0 Context Length: 4k
keeeeenw/MicroLlama
Text Generation • 0.3B • Updated • 365 • 53Note License: apache-2.0 Context Length: 2k
google/gemma-3-270m
Text Generation • 0.3B • Updated • 1.44M • 1.07kNote License: gemma Context Length: 32k
UUFO-Aigis/Pico-OpenLAiNN-250M
0.3B • Updated • 11 • 3Note License: apache-2.0 Context Length: 2k
upstage/TinySolar-248m-4k
Text Generation • 0.2B • Updated • 491 • 12Note License: apache-2.0 Context Length: 4k
M4-ai/TinyMistral-248M-v3
Text Generation • 0.2B • Updated • 113 • 8Note License: apache-2.0 Context Length: 2k
LiquidAI/LFM2.5-230M-Base
Text Generation • 0.2B • Updated • 12.4k • 17Note License: lfm1.0 Context Length: 32k
MiniLLM/MiniPLM-llama3.1-212M
Text Generation • 0.2B • Updated • 14 • 6Note License: apache-2.0 Context Length: 1k
MiniLLM/MiniPLM-Qwen-200M
Text Generation • 0.2B • Updated • 292 • 9Note License: apache-2.0 Context Length: 1k
xTimeCrystal/MiniModel-200M-Base
Text Generation • 0.2B • Updated • 61 • 30Note License: apache-2.0 Context Length: 2k
princeton-nlp/Sheared-Pythia-160m
Text Generation • Updated • 54 • 4Note License: apache-2.0 Context Length: 2k
JackFram/llama-160m
Text Generation • 0.2B • Updated • 195k • 37Note License: apache-2.0 Context Length: 2k
SmallDoge/Doge-160M
Text Generation • 0.2B • Updated • 46 • 7Note License: apache-2.0 Context Length: 2k
EleutherAI/pythia-160m
Text Generation • 0.2B • Updated • 3.35M • 45Note License: apache-2.0 Context Length: 2k
BananaMind/BananaMind-2-Pro-Preview
Text Generation • 0.2B • Updated • 986 • 24Note License: other (bananamind-community-license-1.0) Context Length: 3k
Harikrish2727/BetterGPT-150M
Text Generation • 0.2B • Updated • 493 • 1Note License: apache-2.0 Context Length: 2k
jhu-clsp/ettin-decoder-150m
Fill-Mask • Updated • 1.05k • 6Note License: mit Context Length: 8k
StentorLabs/Portimbria-150M
Text Generation • 0.2B • Updated • 57 • 10Note License: apache-2.0 Context Length: 4k
facebook/MobileLLM-R1-140M-base
Text Generation • 0.1B • Updated • 592 • 21Note License: fair-noncommercial-research Context Length: 4k
joelhenwang/OdinNext-138M-Base
Text Generation • 0.1B • Updated • 107 • 2Note License: apache-2.0 Context Length: 2k
openai-community/gpt2
Text Generation • 0.1B • Updated • 13.9M • 3.41kNote License: mit Context Length: 1k
HuggingFaceTB/SmolLM2-135M
Text Generation • 0.1B • Updated • 2.23M • 226Note License: apache-2.0 Context Length: 8k
amd/AMD-Llama-135m
Text Generation • 0.1B • Updated • 14.3k • 120Note License: apache-2.0 Context Length: 2k
AxiomicLabs/GPT-X2.5-135M
Text Generation • 0.1B • Updated • 2.29k • 62Note License: apache-2.0 Context Length: 8k
MaliosDark/Nexus-Erebus-135M
Text Generation • 0.1B • Updated • 443 • 9Note License: other Context Length: 1k
MiniLLM/MiniPLM-Mamba-130M
Text Generation • 0.1B • Updated • 65 • 4Note License: apache-2.0 Context Length: 1k
Nikity/lille-130m-base
Text Generation • 0.1B • Updated • 145 • 17Note License: apache-2.0 Context Length: 0.5k
EleutherAI/gpt-neo-125m
Text Generation • 0.2B • Updated • 490k • 228Note License: mit Context Length: 2k
opencerebral/Boris-1.3-125M
Text Generation • 0.1B • Updated • 303 • 3Note License: apache-2.0 Context Length: 1k
TobiasLogic/Museko-125M
Text Generation • 0.1B • Updated • 529 • 8Note License: apache-2.0 Context Length: 2k
facebook/opt-125m
Text Generation • Updated • 16.8M • 293Note License: other (OPT-175B License Agreement, non-commercial research only) Context Length: 2k
BEE-spoke-data/smol_llama-101M-GQA
Text Generation • 0.1B • Updated • 408 • 33Note License: apache-2.0 Context Length: 1k
UUFO-Aigis/Pico-OpenLAiNN-100M
0.1B • Updated • 6 • 1Note License: apache-2.0 Context Length: 2k
SupraLabs/Supra2-100M-Base
Text Generation • 0.1B • Updated • 921 • 21Note License: apache-2.0 Context Length: 1k
raincandy-u/Rain-100M
Text Generation • 97.2M • Updated • 163 • 23Note License: apache-2.0 Context Length: 4k
FlameF0X/TinyMoE-100m-2x8-retrained
Text Generation • 99.8M • Updated • 651 • 3Note License: mit Context Length: 1k
Sandroeth/cali-0.1B
Text Generation • 0.1B • Updated • 202 • 5Note License: apache-2.0 Context Length: 1k
HuggingFaceTB/nanowhale-100m-base
Text Generation • 0.1B • Updated • 769 • 20Note License: apache-2.0 Context Length: 2k
Felladrin/Minueza-2-96M
Text Generation • 96M • Updated • 71 • 6Note License: apache-2.0 Context Length: 4k
Felladrin/Minueza-3-95M-Base
Text Generation • 94.7M • Updated • 55 • 3Note License: apache-2.0 Context Length: 8k
finnianx/Gros-Michel-90m-Base-v2
94.9M • Updated • 655 • 6Note License: not specified Context Length: 1k
appvoid/palmer-006
Text Generation • 91.1M • Updated • 239 • 10Note License: other (appvoid-noncommercial-model-license-1.0) Context Length: 256k
distilbert/distilgpt2
Text Generation • 88.2M • Updated • 2.4M • 637Note License: apache-2.0 Context Length: 1k
Quazim0t0/Escarda-86M-Base
Text Generation • 97.3M • Updated • 3.08k • 3Note License: apache-2.0 Context Length: 4k
Quazim0t0/Byrne-86M-Base
Text Generation • 96.9M • Updated • 147 • 2Note License: apache-2.0 Context Length: 4k
weiser/82M-0.4
Text Generation • 82.1M • Updated • 75Note License: apache-2.0 Context Length: 1k
BEE-spoke-data/smol_llama-81M-tied
Text Generation • 81.3M • Updated • 132 • 10Note License: apache-2.0 Context Length: 1k
opencerebral/Boris-1.3-75M
Text Generation • 77.4M • Updated • 277Note License: apache-2.0 Context Length: 1k
MinimaLabs/KeyLM-75M
Text Generation • 75.3M • Updated • 358 • 17Note License: apache-2.0 Context Length: 2k
GODELEV/Archaea-74M-V1.1
Text Generation • 74M • Updated • 316 • 4Note License: mit Context Length: 1k
EleutherAI/pythia-70m
95.6M • Updated • 521k • 85Note License: apache-2.0 Context Length: 2k
JackFram/llama-68m
Text Generation • Updated • 133k • 38Note License: apache-2.0 Context Length: 2k
jhu-clsp/ettin-decoder-68m
Fill-Mask • Updated • 188 • 1Note License: mit Context Length: 8k
OuteAI/Lite-Oute-1-65M
Text Generation • 65M • Updated • 33 • 12Note License: apache-2.0 Context Length: 2k
WhirlwindAI/MetaNova-1-60M
62.7M • Updated • 179 • 6Note License: apache-2.0 Context Length: 3k
SmallDoge/Doge-60M
Text Generation • 54.6M • Updated • 60 • 5Note License: apache-2.0 Context Length: 2k
BananaMind/BananaMind-2-Medium
Text Generation • 55.9M • Updated • 979 • 16Note License: apache-2.0 Context Length: 3k
MaliosDark/Nexus-Erebus-50M
Text Generation • 54.1M • Updated • 466 • 8Note License: apache-2.0 Context Length: 1k
MaliosDark/Isabel-50M
Text Generation • 54.1M • Updated • 223 • 11Note License: apache-2.0 Context Length: 1k
SupraLabs/Supra-50M-Base
Text Generation • 51.8M • Updated • 2.23k • 40Note License: apache-2.0 Context Length: 1k
veyra-ai/Veyra2-Apricot-50M-Base
Text Generation • 49.3M • Updated • 1.02k • 12Note License: apache-2.0 Context Length: 2k
StentorLabs/Stentor3-50M
Text Generation • 49.4M • Updated • 648 • 5Note License: apache-2.0 Context Length: 4k
GODELEV/Rose-Mini
Text Generation • 49.4M • Updated • 874 • 15Note License: apache-2.0 Context Length: 1k
harrrshall/BarunLM-35M
Text Generation • 35.1M • Updated • 50Note License: apache-2.0 Context Length: 2k
sabari2005/cyberslm-33m-base
Text Generation • 33.5M • Updated • 302 • 1Note License: apache-2.0 Context Length: 4k
Felladrin/Minueza-32M-Base
Text Generation • 32.8M • Updated • 958 • 19Note License: apache-2.0 Context Length: 2k
GerbilLab/Gerbil-A-32m
Text Generation • Updated • 7 • 2Note License: apache-2.0 Context Length: 2k
jhu-clsp/ettin-decoder-32m
Text Generation • Updated • 146Note License: mit Context Length: 8k
fromziro/Er-Large-30M
31.9M • Updated • 91 • 3Note License: apache-2.0 Context Length: 1k
EleutherAI/pythia-31m-deduped
Text Generation • 55.7M • Updated • 1.35k • 5Note License: apache-2.0 Context Length: 2k
BananaMind/BananaMind-2-Mini
Text Generation • 28.3M • Updated • 967 • 16Note License: apache-2.0 Context Length: 4k
BananaMind/BananaMind-2-MoE
Text Generation • 26.1M • Updated • 1.55k • 11Note License: apache-2.0 Context Length: 4k
SmallDoge/Doge-20M
Text Generation • 13.1M • Updated • 790 • 13Note License: apache-2.0 Context Length: 2k
StentorLabs/Stentor3-20M
Text Generation • 20.3M • Updated • 194 • 6Note License: apache-2.0 Context Length: 4k
jhu-clsp/ettin-decoder-17m
Fill-Mask • Updated • 481 • 1Note License: mit Context Length: 8k
MultivexAI/Plyx-15M
Text Generation • 16.1M • Updated • 82 • 5Note License: apache-2.0 Context Length: 512
EleutherAI/pythia-14m-deduped
Text Generation • 39.2M • Updated • 13.8k • 30Note License: apache-2.0 Context Length: 2k
fromziro/Er-Medium-12.5M
12.5M • Updated • 82 • 11Note License: apache-2.0 Context Length: 384
BananaMind/BananaMind-2-Nano
Text Generation • 12.1M • Updated • 648 • 12Note License: apache-2.0 Context Length: 4k
liodon-ai/slm-10m
Text Generation • 12.1M • Updated • 121 • 13Note License: apache-2.0 Context Length: 1k
Dream-W/ObsidianSmall-Base
Text Generation • 9.77M • Updated • 633 • 3Note License: not specified Context Length: 1k
User01110/CMA-8M
Text Generation • 9.08M • Updated • 630 • 18Note License: apache-2.0 Context Length: 1k
DedeProGames/DynamicMind-Mini
8.88M • Updated • 486 • 4Note License: apache-2.0 Context Length: 1k
Harley-ml/Tenete-8M
Text Generation • 8.29M • Updated • 47 • 7Note License: mit Context Length: 1k
AtomixLabs/AtomixS2-5M-v1.0
Text Generation • 5.98M • Updated • 542 • 4Note License: apache-2.0 Context Length: 512
LH-Tech-AI/Spark-5M-Base-v4
Text Generation • 4.98M • Updated • 66 • 3Note License: not specified Context Length: 512
MaliosDark/Nexus-Erebus-3M
Text Generation • 3M • Updated • 308 • 3Note License: mit Context Length: 512
UniversalComputingResearch/Atom2.7m
Text Generation • 2.74M • Updated • 204 • 16Note License: apache-2.0 Context Length: 512
MihaiPopa-1/CinnabarLM-1.4M-Base
Text Generation • 1.51M • Updated • 85Note License: apache-2.0 Context Length: 2k
Harley-ml/Dillionv2-1.3M
Text Generation • 1.29M • Updated • 474 • 4Note License: mit Context Length: 384
fromziro/Er-Tiny-1.3M
1.33M • Updated • 142 • 6Note License: apache-2.0 Context Length: 384
56m/Dumb-1.2-RC1
Text Generation • 34.6M • Updated • 351Note License: apache-2.0 Context Length: 1k
AtomixLabs/Photon-2.0-1M
Text Generation • 1.05M • Updated • 957 • 8Note License: apache-2.0 Context Length: 512
Glint-Research/Glint-1.3
Updated • 249 • 11Note License: mit Context Length: 256