Foundation Text-Generation Models Below 360M Parameters - a Felladrin Collection

Felladrin 's Collections

Frequently Used Spaces

Trained Models 🏋️

Foundation Text-Generation Models Below 360M Parameters

Foundation Text-Generation Models Below 360M Parameters

updated 1 day ago

Great candidates for fine-tuning targeting Wllama and Transformers.js for mobile devices, ordered by number of parameters.

HuggingFaceTB/SmolLM2-360M

Text Generation • Updated 17 days ago • 15.7k • 38

Note License: apache-2.0
OuteAI/Lite-Oute-1-300M

Text Generation • Updated Aug 24, 2024 • 349 • 7

Note License: apache-2.0
cerebras/Cerebras-GPT-256M

Text Generation • Updated Nov 22, 2023 • 2.1k • 25

Note License: apache-2.0
upstage/TinySolar-248m-4k

Text Generation • Updated Feb 7, 2024 • 752 • 5

Note License: apache-2.0
M4-ai/TinyMistral-248M-v3

Text Generation • Updated Oct 20, 2024 • 222 • 6

Note License: apache-2.0
MiniLLM/MiniPLM-llama3.1-212M

Text Generation • Updated Oct 27, 2024 • 936 • 2

Note License: apache-2.0
MiniLLM/MiniPLM-Qwen-200M

Text Generation • Updated Oct 27, 2024 • 285 • 2

Note License: apache-2.0
princeton-nlp/Sheared-Pythia-160m

Text Generation • Updated Dec 4, 2023 • 101 • 4

Note License: apache-2.0
JackFram/llama-160m

Text Generation • Updated Jan 4, 2024 • 257k • 33

Note License: apache-2.0
SmallDoge/Doge-160M

Text Generation • Updated 6 days ago • 3.74k • 2

Note License: apache-2.0
EleutherAI/pythia-160m

Text Generation • Updated Jul 9, 2023 • 164k • • 29

Note License: apache-2.0
HuggingFaceTB/SmolLM-135M

Text Generation • Updated Aug 1, 2024 • 164k • • 194

Note License: apache-2.0
amd/AMD-Llama-135m

Text Generation • Updated Oct 9, 2024 • 18.2k • • 111

Note License: apache-2.0
MiniLLM/MiniPLM-Mamba-130M

Text Generation • Updated Oct 27, 2024 • 108 • 2

Note License: apache-2.0
EleutherAI/gpt-neo-125m

Text Generation • Updated Jan 31, 2024 • 122k • • 196

Note License: mit
cerebras/Cerebras-GPT-111M

Text Generation • Updated Nov 22, 2023 • 4.58k • • 76

Note License: apache-2.0
BEE-spoke-data/smol_llama-101M-GQA

Text Generation • Updated Dec 25, 2023 • 5.08k • • 28

Note License: apache-2.0
openai-community/gpt2

Text Generation • Updated Feb 19, 2024 • 17.1M • • 2.59k

Note License: mit
distilbert/distilgpt2

Text Generation • Updated Feb 19, 2024 • 1.72M • • 484

Note License: apache-2.0
BEE-spoke-data/smol_llama-81M-tied

Text Generation • Updated Nov 20, 2023 • 2.96k • 6

Note License: apache-2.0
weiser/82M-0.4

Text Generation • Updated Nov 12, 2024 • 70

Note License: apache-2.0
KylinC/Llama-3-74M

Text Generation • Updated Apr 29, 2024 • 61

Note License: mit
EleutherAI/pythia-70m

Updated Nov 21, 2023 • 60.2k • 63

Note License: apache-2.0
JackFram/llama-68m

Text Generation • Updated May 23, 2024 • 515k • 26

Note License: apache-2.0
OuteAI/Lite-Oute-1-65M

Text Generation • Updated Aug 25, 2024 • 227 • 9

Note License: apache-2.0
SmallDoge/Doge-60M

Text Generation • Updated 6 days ago • 74.7k • 4

Note License: apache-2.0
Felladrin/Minueza-32M-Base

Text Generation • Updated Mar 10, 2024 • 477 • 16

Note License: apache-2.0
GerbilLab/Gerbil-A-32m

Text Generation • Updated Mar 30, 2023 • 163 • 2

Note License: apache-2.0
EleutherAI/pythia-31m

Text Generation • Updated Jul 26, 2023 • 10.1k • 5

Note License: apache-2.0
EleutherAI/pythia-14m

Text Generation • Updated Jul 26, 2023 • 149k • 20

Note License: apache-2.0