UFO: A UI-Focused Agent for Windows OS Interaction
UFO uses two agents to inspect Windows application interfaces and their control metadata, then grounds and executes user requests within and across applications. The study evaluates this UI-focused architecture on nine Windows applications.
AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.
What is this resource?
- Resource type
- Research papers
- Environment
- windows, desktop
- Topics
- cross-app, planning, grounding, automation
- Record publication date
- 2024-02-08
- Evidence retrieved
- 2026-10-16T06:31:24Z
- Resource ID
- arxiv:2402.07939
Recorded paper version
Version updated: 2024-05-23T05:18:58Z.
This identifies the retained arXiv metadata snapshot; newly observed changes require separate review.
Abstract fingerprint
533acb1c9aa3f1c77adb2c67779da86e3d5de95264ba3ec1f81d803f67da7753Authors
Chaoyun Zhang, Liqun Li, Shilin He, Xu Zhang, Bo Qiao, Si Qin, Minghua Ma, Yu Kang, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Qi Zhang
Cite this paper
Download BibTeX · Download CSL JSON
Citations preserve the selected source edition, its authors and recorded date precision. Unrecorded venues and identifiers are omitted.
Publication record
- Title
- UFO: A UI-Focused Agent for Windows OS Interaction
- Authors
- Chaoyun Zhang, Liqun Li, Shilin He, Xu Zhang, Bo Qiao, Si Qin, Minghua Ma, Yu Kang, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Qi Zhang
- Publication date (recorded precision)
- 2025-04
- Venue
- Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
- Publisher
- Association for Computational Linguistics
- Pages
- 597-622
- DOI
- 10.18653/v1/2025.naacl-long.26
Publication source ↗ · Publisher or author PDF ↗
Publication BibTeX · Publication CSL JSON
This publication is a separately recorded edition of the same work. Its citation uses its own title, authors and date; the retained arXiv citation above is unchanged.
Date source: Explicit publisher citation_publication_date: 2025/4. Preserve supplied precision; do not substitute conference event dates.
Source notes: Publisher proceedings edition; retained separately from the arXiv snapshot.
Explore related topics
Scope and limitations
The annotation and scope were reviewed against the primary paper abstract. Experimental results and released artifacts have not been independently reproduced.
Connected assets
These links come from reviewed resource records. A documentation link does not imply a training-data or evaluation dependency.
- Documented resource: UFO · Agents · relationship evidence
Primary evidence and verification
Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.
- arxiv api
Retrieved 2026-10-16T06:31:24Z. Supports: name, authors, published_at, updated_at, identifiers.arxiv, details.arxiv_snapshot.
Content fingerprint
3aac6e9748769efff3c475ede0da192776daa03431d231b5f67e2aa50f8a3be9 - editorial primary review
Retrieved 2026-10-18T04:09:48Z. Supports: details.publication.authors, details.publication.date_basis, details.publication.date_parts, details.publication.doi, details.publication.identity_basis, details.publication.notes, details.publication.pages, details.publication.pdf_url, details.publication.publisher, details.publication.title, details.publication.type, details.publication.url, details.publication.venue.
Content fingerprint
bbe15e312bcbc923811ef73e561fa7db6a7244ee3747bb9e3792e166b9327235 - editorial primary review
Retrieved 2026-10-16T06:31:24Z. Supports: name, kind, summary, environments, topics, scope.
Content fingerprint
3aac6e9748769efff3c475ede0da192776daa03431d231b5f67e2aa50f8a3be9
Suggest a correction
Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.