# Focused Omni-Modal GUI Agents

FocusGUI learns step-specific weights over screenshot, audio, video and interaction-context channels, injecting a compact residual into a frozen decoder without pruning its inputs.

- Catalog URL: https://awesomecua.github.io/resources/arxiv-2610-26203/
- Original source: https://arxiv.org/abs/2610.26203
- Kind: paper
- Review: curated
- Scope: core
- Environments: android
- Topics: screen-understanding, grounding, imitation-learning, interaction-history, mobile-navigation
- Evidence checked: 2026-10-20T08:27:26.236797+00:00
- ID: arxiv:2610.26203

## Limitations

Reviewed the complete retained abstract and selected v1 method/evaluation sections. OmniGUI uses episode-disjoint reference-action evaluation; Type Match, Exact Match and Goal Progress are not presented as independently demonstrated live task-success gains. The Android role is explicit in Appendix D.1. No reproduction or artifact-release verification.

- Record JSON: https://awesomecua.github.io/resources/arxiv-2610-26203/record.json

## Authors

Fuyao Zhang, Wenwen He, Jiaming Zhang, Yurong Hao, Xuan Wang, Guowei Guan, Che Wang, Longtao Huang, Wei Yang Bryan Lim

## Citation exports

- BibTeX: https://awesomecua.github.io/resources/arxiv-2610-26203/citation.bib
- CSL JSON: https://awesomecua.github.io/resources/arxiv-2610-26203/citation.csl.json

## Recorded arXiv snapshot

- Version: 1
- Version source: https://arxiv.org/abs/2610.26203v1
- First submission: 2026-10-19T11:30:48Z
- Version updated: 2026-10-19T11:30:48Z
- Abstract SHA-256: 41178d19a23653c0f49423b8f725584bded7ab8819a1a46e83a062794460b4cb
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?search_query=%28ti%3A%22computer+use%22+OR+ti%3A%22computer-use%22+OR+ti%3A%22GUI+agent%22+OR+ti%3A%22GUI+agents%22+OR+ti%3A%22GUI+grounding%22+OR+ti%3A%22web+agent%22+OR+ti%3A%22browser+agent%22%29+AND+submittedDate%3A%5B202610060000+TO+202610200000%5D&start=0&max_results=200&sortBy=submittedDate&sortOrder=descending (retrieved 2026-10-20T05:52:00Z; SHA-256 af310824eea97aac8209023ff53bad7bea77778816586b10bb94110148347af9)
- https://export.arxiv.org/api/query?search_query=%28ti%3A%22computer+use%22+OR+ti%3A%22computer-use%22+OR+ti%3A%22GUI+agent%22+OR+ti%3A%22GUI+agents%22+OR+ti%3A%22GUI+grounding%22+OR+ti%3A%22web+agent%22+OR+ti%3A%22web+agents%22+OR+ti%3A%22browser+agent%22+OR+ti%3A%22browser+agents%22+OR+ti%3A%22mobile+agent%22+OR+ti%3A%22mobile+agents%22+OR+ti%3A%22desktop+agent%22%29+AND+submittedDate%3A%5B202610130000+TO+202610192359%5D&start=0&max_results=200&sortBy=submittedDate&sortOrder=descending (retrieved 2026-10-20T08:27:26.236797+00:00; SHA-256 80bed80786f939973d0d13b4f892300fee02a6110e326247131fc83d257796de)
- https://arxiv.org/html/2610.26203v1 (retrieved 2026-10-20T09:17:23.872790+00:00; SHA-256 28848f8f597b2a8865ad98f5aa1e4401e15a49f92b33f7bce4d4f044c168ada0)