CS-Bench: A Comprehensive Benchmark for Large Language Models towards Computer Science Mastery
Paper • 2406.08587 • Published • 16
Papers-Benchmarks
-
-
Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoning
Paper • 2406.09170 • Published • 27 -
AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents
Paper • 2407.18901 • Published • 35 -
Benchmarking Agentic Workflow Generation
Paper • 2410.07869 • Published • 29 -
OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotations
Paper • 2412.07626 • Published • 29 -
opendatalab/OmniDocBench
Viewer • Updated • 1.36k • 10.7k • 78 -
OmniEval
🥇4 -
RUC-NLPIR/OmniEval-AutoGen-Dataset
Updated • 61 • 6 -
m-ric/agents_medium_benchmark_2
Viewer • Updated • 142 • 79 • 11 -
gaia-benchmark/GAIA
Viewer • Updated • 932 • 35k • 626 -
GAIA: a benchmark for General AI Assistants
Paper • 2311.12983 • Published • 245 -
m-ric/agents_small_benchmark
Viewer • Updated • 100 • 116 • 11 -
EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agents
Paper • 2502.09560 • Published • 35 -
m-a-p/CodeCriticBench
Preview • Updated • 79 • 4 -
MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents
Paper • 2503.01935 • Published • 30 -
SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?
Paper • 2502.12115 • Published • 46 -
MMTEB: Massive Multilingual Text Embedding Benchmark
Paper • 2502.13595 • Published • 45 -
kyutai/Babillage
Viewer • Updated • 465k • 64 • 13 -
YourBench: Easy Custom Evaluation Sets for Everyone
Paper • 2504.01833 • Published • 22 -
Agent Reward Bench Demo
💻5Explore agent trajectories and judgments in web benchmarks
-
AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories
Paper • 2504.08942 • Published • 28 -
Benchmarking LLMs' Swarm intelligence
Paper • 2505.04364 • Published • 20 -
FullFront: Benchmarking MLLMs Across the Full Front-End Engineering Workflow
Paper • 2505.17399 • Published • 14 -
MultiFinBen: A Multilingual, Multimodal, and Difficulty-Aware Benchmark for Financial LLM Evaluation
Paper • 2506.14028 • Published • 93 -
Benchmark^2: Systematic Evaluation of LLM Benchmarks
Paper • 2601.03986 • Published • 34 -
Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces
Paper • 2601.11868 • Published • 34