# Navigation Alone Is Not Enough: Evaluating Explanatory Assistive UI Agents

Introduces NeXUI, an assistive UI-agent benchmark that evaluates navigation together with interface-grounded explanations and user oversight in recorded interface states.

- Catalog URL: https://awesomecua.github.io/resources/arxiv-2608-09944/
- Original source: https://arxiv.org/abs/2608.09944
- Kind: paper
- Review: curated
- Scope: core
- Environments: web
- Topics: evaluation, human-in-the-loop, web-navigation
- Evidence checked: 2026-10-18T10:00:45.064380+00:00
- ID: arxiv:2608.09944

## Limitations

Packaged tasks use recorded linear transition graphs. Reported model experiments use a text-input validation subset, so their results are not evidence of screenshot-based navigation performance. No results were independently reproduced. Basis: complete retained abstract and source-reviewed sections of the exact-version paper (3.3 Interface states and task annotations; 3.4 Evaluation; 4.1 Models and experimental setup; 5 Discussion); not an entire-paper reading or reproduction claim.

- Record JSON: https://awesomecua.github.io/resources/arxiv-2608-09944/record.json

## Authors

Santosh Patapati

## Citation exports

- BibTeX: https://awesomecua.github.io/resources/arxiv-2608-09944/citation.bib
- CSL JSON: https://awesomecua.github.io/resources/arxiv-2608-09944/citation.csl.json

## Recorded arXiv snapshot

- Version: 1
- Version source: https://arxiv.org/abs/2608.09944v1
- First submission: 2026-07-01T16:24:07Z
- Version updated: 2026-07-01T16:24:07Z
- Abstract SHA-256: d5ccb0d41798a1a3236e6f9b4361814cccdd40facf9b43bf0bf52932337484dc
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?search_query=%28ti%3A%22computer+use%22+OR+ti%3A%22computer-use%22+OR+ti%3A%22GUI+agent%22+OR+ti%3A%22GUI+agents%22+OR+ti%3A%22GUI+grounding%22+OR+ti%3A%22web+agents%22+OR+ti%3A%22browser+agent%22+OR+ti%3A%22mobile+agent%22+OR+ti%3A%22UI+agent%22+OR+ti%3A%22desktop+agent%22+OR+ti%3A%22screen+grounding%22%29+AND+submittedDate%3A%5B200001010000+TO+202610180000%5D&start=200&max_results=100&sortBy=submittedDate&sortOrder=descending (retrieved 2026-10-18T10:00:45.064380+00:00; SHA-256 f26fba818a44c6a7f541ab3b0341ca8f4798d837a425a2ac9fb0fc47a553b7bc)
- https://export.arxiv.org/api/query?search_query=%28ti%3A%22computer+use%22+OR+ti%3A%22computer-use%22+OR+ti%3A%22GUI+agent%22+OR+ti%3A%22GUI+agents%22+OR+ti%3A%22GUI+grounding%22+OR+ti%3A%22web+agents%22+OR+ti%3A%22browser+agent%22+OR+ti%3A%22mobile+agent%22+OR+ti%3A%22UI+agent%22+OR+ti%3A%22desktop+agent%22+OR+ti%3A%22screen+grounding%22%29+AND+submittedDate%3A%5B200001010000+TO+202610180000%5D&start=200&max_results=100&sortBy=submittedDate&sortOrder=descending (retrieved 2026-10-18T10:00:45.064380+00:00; SHA-256 f26fba818a44c6a7f541ab3b0341ca8f4798d837a425a2ac9fb0fc47a553b7bc)
- https://arxiv.org/html/2608.09944v1 (retrieved 2026-10-18T10:05:26.923383+00:00; SHA-256 777197864eeaa34d180bf6b91f32408b7b3d8cc5c9faecc95eca276f5bd426de)