# OSUniverse: Benchmark for Multimodal GUI-navigation AI Agents

Introduces OSUniverse, a desktop GUI benchmark spanning precise clicks through multistep and multiapplication tasks. It provides both manual scoring and an automated validation mechanism.

- Catalog URL: https://awesomecua.github.io/resources/arxiv-2505-03570/
- Original source: https://arxiv.org/abs/2505.03570
- Kind: paper
- Review: curated
- Scope: core
- Environments: desktop
- Topics: evaluation, cross-app, long-horizon
- Evidence checked: 2026-10-17T11:20:17Z
- ID: arxiv:2505.03570

## Limitations

Reviewed against the exact-version official arXiv abstract page; its complete title, ordered author list, visible version, and normalized abstract SHA match the retained snapshot. The original API response body was not locally available. Experimental results and artifact availability have not been independently reproduced.

- Record JSON: https://awesomecua.github.io/resources/arxiv-2505-03570/record.json

## Authors

Mariya Davydova, Daniel Jeffries, Patrick Barker, Arturo Márquez Flores, Sinéad Ryan

## Citation exports

- BibTeX: https://awesomecua.github.io/resources/arxiv-2505-03570/citation.bib
- CSL JSON: https://awesomecua.github.io/resources/arxiv-2505-03570/citation.csl.json

## Recorded arXiv snapshot

- Version: 1
- Version source: https://arxiv.org/abs/2505.03570v1
- First submission: 2025-05-06T14:29:47Z
- Version updated: 2025-05-06T14:29:47Z
- Abstract SHA-256: e8bb4c6f8080ed1ee91e1089233cae6f231ab3256b38ac7d6403ebea3ae56fe0
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?id_list=2504.03206%2C2504.03601%2C2504.06821%2C2504.09723%2C2504.11301%2C2504.11543%2C2504.12609%2C2504.14233%2C2504.14348%2C2504.14603%2C2504.16073%2C2504.16419%2C2504.17892%2C2504.18580%2C2504.20965%2C2505.00019%2C2505.00693%2C2505.01578%2C2505.02094%2C2505.03570%2C2505.03574%2C2505.05026%2C2505.05849%2C2505.06507%2C2505.07003%2C2505.07473%2C2505.10468%2C2505.10887%2C2505.12053%2C2505.12490%2C2505.12728%2C2505.13291%2C2505.14030%2C2505.14454%2C2505.14646%2C2505.15801%2C2505.15816%2C2505.17020%2C2505.18746%2C2505.19095%2C2505.19713%2C2505.20023%2C2505.20732%2C2505.20795%2C2505.21055%2C2505.22304%2C2505.22429%2C2505.23450%2C2505.23559%2C2506.00641&max_results=50 (retrieved 2026-10-17T07:57:47Z; SHA-256 27144160e8981bb9f36b60c391689774913ff3f026eeeffc2923154c404a6529)
- https://arxiv.org/abs/2505.03570v1 (retrieved 2026-10-17T11:20:17Z; SHA-256 39de8f4a9aee74cc0eae64e24efc08ed070714eaaea4a30dbc20cb08397eb9bd)