33
Arabic Tokenizers Leaderboard
⚡
Tokenize Arabic text and benchmark tokenizers
Mohamed Rashad PRO
MohamedRashad
AI & ML interests
Computer Vision, Robotics, Natural Language Processing
Recent Activity
new activity
about 11 hours ago
MohamedRashad/Flux-Redux:Flux-Redux Paused Status
new activity
about 22 hours ago
MohamedRashad/Infinity:Fixes 500 error for some users
updated
a Space
1 day ago
MohamedRashad/arabic-tokenizers-leaderboard
Organizations
MohamedRashad's activity
Flux-Redux Paused Status
1
#1 opened about 18 hours ago
by
Resoldjew
Fixes 500 error for some users
1
#1 opened 1 day ago
by
Tonic
updated
a
Space
1 day ago
liked
a
Space
1 day ago
Adding Arabert
2
#3 opened 4 days ago
by
wissamantoun
liked
a
model
1 day ago
liked
a
Space
10 days ago
Can't see reranking submission
3
#1 opened 13 days ago
by
anondeb
reacted to
their
post with 🔥
13 days ago
Post
3229
Today is a big day for the Arabic Language,
We have Navid-AI/The-Arabic-Rag-Leaderboard,
an Update for OALL/Open-Arabic-LLM-Leaderboard
and the release of atlasia/darija-chatbot-arena
All of this announcements was under 12 hours of time 🤯
We have Navid-AI/The-Arabic-Rag-Leaderboard,
an Update for OALL/Open-Arabic-LLM-Leaderboard
and the release of atlasia/darija-chatbot-arena
All of this announcements was under 12 hours of time 🤯
posted
an
update
13 days ago
Post
3229
Today is a big day for the Arabic Language,
We have Navid-AI/The-Arabic-Rag-Leaderboard,
an Update for OALL/Open-Arabic-LLM-Leaderboard
and the release of atlasia/darija-chatbot-arena
All of this announcements was under 12 hours of time 🤯
We have Navid-AI/The-Arabic-Rag-Leaderboard,
an Update for OALL/Open-Arabic-LLM-Leaderboard
and the release of atlasia/darija-chatbot-arena
All of this announcements was under 12 hours of time 🤯
reacted to
lewtun's
post with ❤️
13 days ago
Post
4483
Introducing OpenR1-Math-220k!
open-r1/OpenR1-Math-220k
The community has been busy distilling DeepSeek-R1 from inference providers, but we decided to have a go at doing it ourselves from scratch 💪
What’s new compared to existing reasoning datasets?
♾ Based on AI-MO/NuminaMath-1.5: we focus on math reasoning traces and generate answers for problems in NuminaMath 1.5, an improved version of the popular NuminaMath-CoT dataset.
🐳 800k R1 reasoning traces: We generate two answers for 400k problems using DeepSeek R1. The filtered dataset contains 220k problems with correct reasoning traces.
📀 512 H100s running locally: Instead of relying on an API, we leverage vLLM and SGLang to run generations locally on our science cluster, generating 180k reasoning traces per day.
⏳ Automated filtering: We apply Math Verify to only retain problems with at least one correct answer. We also leverage Llama3.3-70B-Instruct as a judge to retrieve more correct examples (e.g for cases with malformed answers that can’t be verified with a rules-based parser)
📊 We match the performance of DeepSeek-Distill-Qwen-7B by finetuning Qwen-7B-Math-Instruct on our dataset.
🔎 Read our blog post for all the nitty gritty details: https://huggingface.co/blog/open-r1/update-2
open-r1/OpenR1-Math-220k
The community has been busy distilling DeepSeek-R1 from inference providers, but we decided to have a go at doing it ourselves from scratch 💪
What’s new compared to existing reasoning datasets?
♾ Based on AI-MO/NuminaMath-1.5: we focus on math reasoning traces and generate answers for problems in NuminaMath 1.5, an improved version of the popular NuminaMath-CoT dataset.
🐳 800k R1 reasoning traces: We generate two answers for 400k problems using DeepSeek R1. The filtered dataset contains 220k problems with correct reasoning traces.
📀 512 H100s running locally: Instead of relying on an API, we leverage vLLM and SGLang to run generations locally on our science cluster, generating 180k reasoning traces per day.
⏳ Automated filtering: We apply Math Verify to only retain problems with at least one correct answer. We also leverage Llama3.3-70B-Instruct as a judge to retrieve more correct examples (e.g for cases with malformed answers that can’t be verified with a rules-based parser)
📊 We match the performance of DeepSeek-Distill-Qwen-7B by finetuning Qwen-7B-Math-Instruct on our dataset.
🔎 Read our blog post for all the nitty gritty details: https://huggingface.co/blog/open-r1/update-2
upvoted
an
article
13 days ago
Article
Arabic RAG Leaderboard: A Comprehensive Framework for Evaluating Arabic Language Retrieval Systems
By
and 1 other
•
•
11
updated
a
Space
14 days ago
liked
a
Space
14 days ago
published
an
article
14 days ago
Article
Arabic RAG Leaderboard: A Comprehensive Framework for Evaluating Arabic Language Retrieval Systems
By
and 1 other
•
•
11
published
an
article
14 days ago
Article
Arabic RAG Leaderboard: A Comprehensive Framework for Evaluating Arabic Language Retrieval Systems
By
and 1 other
•
•
11
published
a
Space
15 days ago
updated
a
Space
15 days ago
updated
a
Space
16 days ago