Scaling test-time compute
📈
587
Implement test-time compute scaling for math problems
MiscSpaces
-
-
FineWeb: decanting the web for the finest text data at scale
🍷1.23kGenerate high-quality text data for LLMs using FineWeb
-
The Ultra-Scale Playbook
🌌3.6kThe ultimate guide to training LLM on large GPU Clusters
-
FineVision: Open Data is All You Need
📝212A new open-source dataset for training VLMs
-
Megatron Memory Estimator
👁19Estimate GPU memory usage for Megatron models
-
Smol2Operator Demo
🐢19Smol2Operator Demo: GUI Agent Model
-
The Smol Training Playbook
📚2.67kThe secrets to building world-class LLMs
-
Unlocking On-Policy Distillation for Any Model Family
📝72Apply on-policy distillation to any model family