# Inferring Alt-text For UI Icons With Large Language Models During App Development

Introduces IconDesc, which generates mobile icon alt-text from partial UI context such as element identifiers, bounds, nearby text and hierarchy. Model evaluation and a user study examine the resulting accessibility descriptions.

- Catalog URL: https://awesomecua.github.io/resources/arxiv-2409-18060/
- Original source: https://arxiv.org/abs/2409.18060
- Kind: paper
- Review: curated
- Scope: adjacent
- Environments: unspecified
- Topics: screen-understanding, ui-design, evaluation
- Evidence checked: 2026-10-16T06:45:04Z
- ID: arxiv:2409.18060

## Limitations

The annotation and scope were reviewed against the complete retained original arXiv abstract. Experimental findings and artifact availability have not been independently reproduced. This is a UI accessibility and element-description method; autonomous GUI control is not evaluated.

- Record JSON: https://awesomecua.github.io/resources/arxiv-2409-18060/record.json

## Authors

Sabrina Haque, Christoph Csallner

## Citation exports

- BibTeX: https://awesomecua.github.io/resources/arxiv-2409-18060/citation.bib
- CSL JSON: https://awesomecua.github.io/resources/arxiv-2409-18060/citation.csl.json

## Recorded arXiv snapshot

- Version: 2
- Version source: https://arxiv.org/abs/2409.18060v2
- First submission: 2024-09-26T17:01:33Z
- Version updated: 2024-10-07T19:04:38Z
- Abstract SHA-256: 2d927b7644f0c6b3a49fbdf1aa976a00f2409adf9a72e1c04333438f66f1014b
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?id_list=2303.17760%2C2310.03720%2C2312.11190%2C2403.02502%2C2406.12639%2C2409.18060%2C2410.00201%2C2501.01702%2C2501.11425%2C2502.02533%2C2502.02955%2C2502.12110%2C2502.15760%2C2502.17110%2C2502.19328%2C2503.02197%2C2503.02403%2C2503.02682%2C2503.06580%2C2503.07365%2C2503.09572%2C2503.14021%2C2503.24180%2C2504.02357%2C2504.11675%2C2504.13936&max_results=26 (retrieved 2026-10-16T06:45:04Z; SHA-256 bab88dfed88ca440c231aa768530374a0f19498777a70921481a904fddd46bb8)
- https://export.arxiv.org/api/query?id_list=2303.17760%2C2310.03720%2C2312.11190%2C2403.02502%2C2406.12639%2C2409.18060%2C2410.00201%2C2501.01702%2C2501.11425%2C2502.02533%2C2502.02955%2C2502.12110%2C2502.15760%2C2502.17110%2C2502.19328%2C2503.02197%2C2503.02403%2C2503.02682%2C2503.06580%2C2503.07365%2C2503.09572%2C2503.14021%2C2503.24180%2C2504.02357%2C2504.11675%2C2504.13936&max_results=26 (retrieved 2026-10-16T06:45:04Z; SHA-256 bab88dfed88ca440c231aa768530374a0f19498777a70921481a904fddd46bb8)