LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models
Paper • 2407.12772 • Published • 35
LMMs-Eval
Dataset Collection of LMMs-Eval
-
-
lmms-lab/VQAv2
Viewer • Updated • 770k • 23k • 32 -
lmms-lab/MME
Viewer • Updated • 2.37k • 39.1k • 31 -
lmms-lab/DocVQA
Viewer • Updated • 16.6k • 29.3k • 78 -
lmms-lab/MMBench
Viewer • Updated • 24k • 25.5k • 22 -
lmms-lab/textvqa
Viewer • Updated • 45.3k • 31.9k • 24 -
lmms-lab/CMMMU
Viewer • Updated • 12k • 536 • 4 -
lmms-lab/RefCOCO
Viewer • Updated • 17.6k • 9.16k • 32 -
lmms-lab/egoschema
Viewer • Updated • 15.6k • 15.5k • 8 -
lmms-lab/VideoChatGPT
Viewer • Updated • 3.49k • 566 • 12 -
lmms-lab/RealWorldQA
Viewer • Updated • 765 • 17.5k • 6 -
lmms-lab/GQA
Viewer • Updated • 24.2M • 35.1k • 31 -
lmms-lab/POPE
Viewer • Updated • 18k • 25.1k • 18 -
lmms-lab/ai2d
Viewer • Updated • 3.09k • 22.1k • 23 -
lmms-lab/ChartQA
Viewer • Updated • 2.5k • 24.3k • 24 -
lmms-lab/TextCaps
Viewer • Updated • 28.4k • 1.33k • 14 -
lmms-lab/COCO-Caption2017
Viewer • Updated • 45.7k • 4.8k • 22 -
lmms-lab/OK-VQA
Viewer • Updated • 5.05k • 3.44k • 8 -
lmms-lab/COCO-Caption
Viewer • Updated • 81.3k • 3.77k • 12 -
lmms-lab/HallusionBench
Viewer • Updated • 1.13k • 3.6k • 10 -
lmms-lab/MMMU
Viewer • Updated • 11.6k • 42.7k • 7 -
lmms-lab/ScienceQA
Viewer • Updated • 12.6k • 17.3k • 9 -
lmms-lab/VizWiz-VQA
Viewer • Updated • 12.3k • 7.45k • 8 -
lmms-lab/MMVet
Viewer • Updated • 218 • 3.5k • 5 -
lmms-lab/RefCOCOplus
Viewer • Updated • 7.58k • 4.89k • 5 -
lmms-lab/llava-bench-in-the-wild
Viewer • Updated • 60 • 6.21k • 10 -
lmms-lab/SEED-Bench
Viewer • Updated • 18k • 13k • 4 -
lmms-lab/RefCOCOg
Viewer • Updated • 12.6k • 3.49k • 9 -
lmms-lab/NoCaps
Viewer • Updated • 15.1k • 907 • 3 -
lmms-lab/flickr30k
Viewer • Updated • 31.8k • 4.78k • 18 -
lmms-lab/MMBench_EN
Viewer • Updated • 11.1k • 1.24k • 7 -
lmms-lab/MMBench_CN
Viewer • Updated • 13.2k • 124 • 3 -
lmms-lab/MP-DocVQA
Viewer • Updated • 10.2k • 1.91k • 5 -
lmms-lab/DC100_EN
Preview • Updated • 18