# UI-Vision

Desktop GUI data for interface understanding and interaction research.

- Catalog URL: https://awesomecua.github.io/resources/url-2c2004baae4669f8169a/
- Original source: https://huggingface.co/datasets/ServiceNow/ui-vision
- Kind: dataset
- Review: curated
- Scope: core
- Environments: desktop
- Topics: grounding, screen-understanding
- Evidence checked: 2026-10-16T06:38:26Z
- ID: url:2c2004baae4669f8169a

## Limitations

Inclusion does not establish reproducibility or endorsement.

- Record JSON: https://awesomecua.github.io/resources/url-2c2004baae4669f8169a/record.json

## Structured profile

- formats: JSON annotations, image files
- modalities: screenshots, bounding boxes, UI labels, action annotations
- splits: not recorded
- supervision: element grounding, layout grounding, action prediction

### Count observations

- 83 software applications — paper-described benchmark coverage (reported; source: https://huggingface.co/datasets/ServiceNow/ui-vision/raw/main/README.md)

This is an offline evaluation dataset. Application coverage is not a sample count. The inspected file-layout documentation describes grounding annotations and images; it does not establish a common split or complete action-trajectory inventory.

## License declarations

- code: not recorded
- data: mit — https://huggingface.co/datasets/ServiceNow/ui-vision
- document: not recorded
- weights: not recorded

## Primary evidence

- https://huggingface.co/api/datasets/ServiceNow/ui-vision (retrieved 2026-10-16T06:38:26Z; SHA-256 34f4ad5c9e7160b5be5aa8ae77e6e9f83a277aada41a272b82a2628d21159a8c)
- https://huggingface.co/datasets/ServiceNow/ui-vision/raw/main/README.md (retrieved 2026-10-17T02:02:37Z; SHA-256 295cf7f7500a18cea5c80eab1cdf4d7264f2f0e959b75efc5ba59083d93c9097)
- https://huggingface.co/api/datasets/ServiceNow/ui-vision (retrieved 2026-10-16T06:38:26Z; SHA-256 34f4ad5c9e7160b5be5aa8ae77e6e9f83a277aada41a272b82a2628d21159a8c)