task_categories:zero-shot-classification license:creativeml-openrail-m size_categories:1K<n<10K format:csv modality:tabular modality:text library:datasets library:pandas library:mlcroissant library:polars arxiv:2211.13854 region:us code
---
license: creativeml-openrail-m
task_categories:
- zero-shot-classification
tags:
- code
size_categories:
- 1K<n<10K
---

Compositional Visual Genome (ComVG) <br/>
ComVG benchmark aims to test vision-language models ability in text-to-image retrieval. <br/>
We selected 542 high-quality images from Visual Genome and created 5400 datapoints in ComVG. <br/>
Each datapoint contains a postive and negative image. The negative image is a mutated
variant with singular discrepancies in subject, object, or predicate.<br/>
For more details on creation process, please refer: https://arxiv.org/abs/2211.13854

