# The Impact of Element Ordering on LM Agent Performance

Studies how the ordering of UI elements in an agent observation affects web and desktop performance. A pixel-based element detector and dimensionality-reduction ordering are evaluated on OmniACT when document hierarchy is unavailable.

- Catalog URL: https://awesomecua.github.io/resources/arxiv-2409-12089/
- Original source: https://arxiv.org/abs/2409.12089
- Kind: paper
- Review: curated
- Scope: core
- Environments: web, desktop
- Topics: screen-understanding, grounding, evaluation
- Evidence checked: 2026-10-16T06:42:42Z
- ID: arxiv:2409.12089

## Limitations

The annotation and scope were reviewed against the complete retained original arXiv abstract. Experimental findings and artifact availability have not been independently reproduced.

- Record JSON: https://awesomecua.github.io/resources/arxiv-2409-12089/record.json

## Authors

Wayne Chi, Ameet Talwalkar, Chris Donahue

## Citation exports

- BibTeX: https://awesomecua.github.io/resources/arxiv-2409-12089/citation.bib
- CSL JSON: https://awesomecua.github.io/resources/arxiv-2409-12089/citation.csl.json

## Recorded arXiv snapshot

- Version: 3
- Version source: https://arxiv.org/abs/2409.12089v3
- First submission: 2024-09-18T16:04:10Z
- Version updated: 2024-10-06T21:25:34Z
- Abstract SHA-256: a2f59976cec7adb9f9c88bd79bdfbeed040e4874b6d9ab0c229136f98101aa98
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?id_list=2008.05132%2C2010.04295%2C2101.04893%2C2112.05692%2C2306.01242%2C2311.03079%2C2401.05459%2C2402.03746%2C2402.15506%2C2403.20329%2C2404.06395%2C2404.10179%2C2405.10292%2C2406.09187%2C2406.14596%2C2408.03326%2C2409.12089%2C2501.10893%2C2504.09352&max_results=19 (retrieved 2026-10-16T06:42:42Z; SHA-256 d1c1bc3fee56d124427abd2aabbcf876418633a8adf7a03f4ef0317cba6a42ae)
- https://export.arxiv.org/api/query?id_list=2008.05132%2C2010.04295%2C2101.04893%2C2112.05692%2C2306.01242%2C2311.03079%2C2401.05459%2C2402.03746%2C2402.15506%2C2403.20329%2C2404.06395%2C2404.10179%2C2405.10292%2C2406.09187%2C2406.14596%2C2408.03326%2C2409.12089%2C2501.10893%2C2504.09352&max_results=19 (retrieved 2026-10-16T06:42:42Z; SHA-256 d1c1bc3fee56d124427abd2aabbcf876418633a8adf7a03f4ef0317cba6a42ae)