# See, Think, Act: Teaching Multimodal Agents to Effectively Interact with GUI by Identifying Toggles

Introduces a benchmark for binary GUI-toggle instructions and State-aware Reasoning, which compares the observed control state with the requested state before choosing an action. It evaluates agents on toggle tasks and broader interactive benchmarks.

- Catalog URL: https://awesomecua.github.io/resources/arxiv-2509-13615/
- Original source: https://arxiv.org/abs/2509.13615
- Kind: paper
- Review: curated
- Scope: core
- Environments: unspecified
- Topics: state-tracking, grounding, evaluation
- Evidence checked: 2026-10-17T11:20:53Z
- ID: arxiv:2509.13615

## Limitations

Reviewed against the exact-version official arXiv abstract page; its complete title, ordered author list, visible version, and normalized abstract SHA match the retained snapshot. The original API response body was not locally available. Experimental results and artifact availability have not been independently reproduced.

- Record JSON: https://awesomecua.github.io/resources/arxiv-2509-13615/record.json

## Authors

Zongru Wu, Rui Mao, Zhiyuan Tian, Pengzhou Cheng, Tianjie Ju, Zheng Wu, Lingzhong Dong, Haiyue Sheng, Zhuosheng Zhang, Gongshen Liu

## Citation exports

- BibTeX: https://awesomecua.github.io/resources/arxiv-2509-13615/citation.bib
- CSL JSON: https://awesomecua.github.io/resources/arxiv-2509-13615/citation.csl.json

## Recorded arXiv snapshot

- Version: 5
- Version source: https://arxiv.org/abs/2509.13615v5
- First submission: 2025-09-17T01:14:14Z
- Version updated: 2026-03-18T08:12:54Z
- Abstract SHA-256: be8620b021bd9218c1143282f1c7a7ea06be2abe6fc0928a310cfc8ac3172a18
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?id_list=2508.20410%2C2508.20890%2C2508.21456%2C2509.00088%2C2509.00531%2C2509.00969%2C2509.01684%2C2509.03536%2C2509.04018%2C2509.04908%2C2509.05368%2C2509.05831%2C2509.06917%2C2509.07098%2C2509.07553%2C2509.08820%2C2509.10345%2C2509.10540%2C2509.11253%2C2509.12543%2C2509.12987%2C2509.13615%2C2509.14547%2C2509.14744%2C2509.15061%2C2509.15237%2C2509.17336%2C2509.19185%2C2509.19199%2C2509.21072%2C2509.21291%2C2509.21766%2C2509.21799%2C2509.22715%2C2509.22830%2C2509.23738%2C2509.24704%2C2509.25455%2C2509.25693%2C2510.00172%2C2510.00515%2C2510.02190%2C2510.04491%2C2510.05096%2C2510.05156%2C2510.05788%2C2510.07284%2C2510.07915%2C2510.08787%2C2510.09517&max_results=50 (retrieved 2026-10-17T07:57:56Z; SHA-256 3429cc2fc7737050cac964c976293fc4793e52c5913636c1f67d04243fbefb6a)
- https://arxiv.org/abs/2509.13615v5 (retrieved 2026-10-17T11:20:53Z; SHA-256 28426488ebca15b74a693ea9fcb2b0ce3165d3baf97b76a4884b34a0d1997af4)