# UFO: A UI-Focused Agent for Windows OS Interaction

UFO uses two agents to inspect Windows application interfaces and their control metadata, then grounds and executes user requests within and across applications. The study evaluates this UI-focused architecture on nine Windows applications.

- Catalog URL: https://awesomecua.github.io/resources/arxiv-2402-07939/
- Original source: https://arxiv.org/abs/2402.07939
- Kind: paper
- Review: curated
- Scope: core
- Environments: windows, desktop
- Topics: cross-app, planning, grounding, automation
- Evidence checked: 2026-10-16T06:31:24Z
- ID: arxiv:2402.07939

## Limitations

The annotation and scope were reviewed against the primary paper abstract. Experimental results and released artifacts have not been independently reproduced.

- Record JSON: https://awesomecua.github.io/resources/arxiv-2402-07939/record.json

## Authors

Chaoyun Zhang, Liqun Li, Shilin He, Xu Zhang, Bo Qiao, Si Qin, Minghua Ma, Yu Kang, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Qi Zhang

## Citation exports

- BibTeX: https://awesomecua.github.io/resources/arxiv-2402-07939/citation.bib
- CSL JSON: https://awesomecua.github.io/resources/arxiv-2402-07939/citation.csl.json

## Publication record

- Title: UFO: A UI-Focused Agent for Windows OS Interaction
- Authors: Chaoyun Zhang, Liqun Li, Shilin He, Xu Zhang, Bo Qiao, Si Qin, Minghua Ma, Yu Kang, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Qi Zhang
- Publication date (recorded precision): 2025-04
- Publication source: https://aclanthology.org/2025.naacl-long.26/
- Publication BibTeX: https://awesomecua.github.io/resources/arxiv-2402-07939/publication-citation.bib
- Publication CSL JSON: https://awesomecua.github.io/resources/arxiv-2402-07939/publication-citation.csl.json
- venue: Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
- publisher: Association for Computational Linguistics
- pages: 597-622
- doi: 10.18653/v1/2025.naacl-long.26
- date basis: Explicit publisher citation_publication_date: 2025/4. Preserve supplied precision; do not substitute conference event dates.
- identity basis: Same work: normalized title, ordered author correspondence and the specific contribution in the complete publisher abstract were reviewed against the retained arXiv identity.
- notes: Publisher proceedings edition; retained separately from the arXiv snapshot.
- Publication evidence: https://aclanthology.org/2025.naacl-long.26/

## Recorded arXiv snapshot

- Version: 5
- Version source: https://arxiv.org/abs/2402.07939v5
- First submission: 2024-02-08T15:40:35Z
- Version updated: 2024-05-23T05:18:58Z
- Abstract SHA-256: 533acb1c9aa3f1c77adb2c67779da86e3d5de95264ba3ec1f81d803f67da7753
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?id_list=2308.03688%2C2308.15272%2C2309.08172%2C2309.11436%2C2310.04716%2C2310.04869%2C2310.05126%2C2310.06770%2C2310.08740%2C2310.10634%2C2310.11441%2C2310.16042%2C2310.18331%2C2311.01767%2C2311.07562%2C2311.09278%2C2311.12983%2C2311.18751%2C2312.03003%2C2312.06677%2C2312.08914%2C2312.11671%2C2312.13108%2C2312.13771%2C2312.15820%2C2312.16062%2C2401.01614%2C2401.04124%2C2401.07781%2C2401.10935%2C2401.13178%2C2401.13649%2C2401.13919%2C2401.14268%2C2401.16158%2C2402.01030%2C2402.04476%2C2402.04615%2C2402.05930%2C2402.06596%2C2402.07456%2C2402.07939%2C2402.07945%2C2402.08567%2C2402.11941%2C2402.14073%2C2402.15057%2C2402.16965%2C2402.17553%2C2403.02713&max_results=50 (retrieved 2026-10-16T06:31:24Z; SHA-256 3aac6e9748769efff3c475ede0da192776daa03431d231b5f67e2aa50f8a3be9)
- https://aclanthology.org/2025.naacl-long.26/ (retrieved 2026-10-18T04:09:48Z; SHA-256 bbe15e312bcbc923811ef73e561fa7db6a7244ee3747bb9e3792e166b9327235)
- https://export.arxiv.org/api/query?id_list=2308.03688%2C2308.15272%2C2309.08172%2C2309.11436%2C2310.04716%2C2310.04869%2C2310.05126%2C2310.06770%2C2310.08740%2C2310.10634%2C2310.11441%2C2310.16042%2C2310.18331%2C2311.01767%2C2311.07562%2C2311.09278%2C2311.12983%2C2311.18751%2C2312.03003%2C2312.06677%2C2312.08914%2C2312.11671%2C2312.13108%2C2312.13771%2C2312.15820%2C2312.16062%2C2401.01614%2C2401.04124%2C2401.07781%2C2401.10935%2C2401.13178%2C2401.13649%2C2401.13919%2C2401.14268%2C2401.16158%2C2402.01030%2C2402.04476%2C2402.04615%2C2402.05930%2C2402.06596%2C2402.07456%2C2402.07939%2C2402.07945%2C2402.08567%2C2402.11941%2C2402.14073%2C2402.15057%2C2402.16965%2C2402.17553%2C2403.02713&max_results=50 (retrieved 2026-10-16T06:31:24Z; SHA-256 3aac6e9748769efff3c475ede0da192776daa03431d231b5f67e2aa50f8a3be9)