HuggingFaceFW/fineweb
Viewer
•
Updated
•
52.5B
•
311k
•
2.32k
📚 LLM pretraining datasets
A collection of datasets for LLM pretraining
-
HuggingFaceFW/fineweb-2
Viewer • Updated • 5.02B • 68.3k • 620Note 🍷 Web datasets
-
HuggingFaceFW/fineweb-edu
Viewer • Updated • 3.5B • 81.7k • 737
mlfoundations/dclm-baseline-1.0
Preview • Updated • 72.5k • 231Note 📚 Highly curated web datasets filtered using classifiers
HuggingFaceTB/finemath
Viewer • Updated • 48.3M • 5.07k • 330Note 📐 Highly curated math pages from CommonCrawl
-
bigcode/the-stack
Viewer • Updated • 546M • 9.63k • 846
bigcode/the-stack-v2
Viewer • Updated • 5.45B • 3.42k • 403Note 💻 Github code dataset
HuggingFaceTB/cosmopedia
Viewer • Updated • 31.1M • 5k • 634Note Synthetic textbooks
HuggingFaceTB/smollm-corpus
Viewer • Updated • 237M • 14.3k • 368Note Contains Cosmopedia v2 (synthetic textbooks) and Python-Edu (educational Python code)