vansin
vansin
AI & ML interests
None yet
Recent Activity
commented on
a paper
2 days ago
LServe: Efficient Long-sequence LLM Serving with Unified Sparse
Attention
new activity
3 days ago
cais/hle:Application of InternLM3 to Join the leaderboard
new activity
3 days ago
vectara/leaderboard:Application of InternLM3 to Join the leaderboard
Organizations
vansin's activity
reacted to
their
post with 🚀🔥
3 months ago
reacted to
their
post with 👀
3 months ago
Post
1262
Amazing !!!! test Post
reacted to
loubnabnl's
post with 🔥
3 months ago
Post
2752
Making SmolLM2 reproducible: open-sourcing our training & evaluation toolkit 🛠️ https://github.com/huggingface/smollm/
- Pre-training code with nanotron
- Evaluation suite with lighteval
- Synthetic data generation using distilabel (powers our new SFT dataset HuggingFaceTB/smoltalk)
- Post-training scripts with TRL & the alignment handbook
- On-device tools with llama.cpp for summarization, rewriting & agents
Apache 2.0 licensed. V2 pre-training data mix coming soon!
Which other tools should we add next?
- Pre-training code with nanotron
- Evaluation suite with lighteval
- Synthetic data generation using distilabel (powers our new SFT dataset HuggingFaceTB/smoltalk)
- Post-training scripts with TRL & the alignment handbook
- On-device tools with llama.cpp for summarization, rewriting & agents
Apache 2.0 licensed. V2 pre-training data mix coming soon!
Which other tools should we add next?