license:apache-2.0 size_categories:n<1K format:imagefolder modality:image library:datasets library:mlcroissant region:us
---
license: apache-2.0
---

We share a comprehensive GUI instruction grounding dataset. It contains 2646 desktop screenshot images along with their annotations.
The screenshot images can be found in the folder "images" and the annotation file can be found under "annotations".
The annotation JSON largely follows the coco annotation structure with a few additional keys.

We provide 7 screen element categories:
Button, 
Tab,
Text field/area,
Link,
Checkbox,
Radio button,
and List. 
