# VUT: Versatile UI Transformer for Multi-Modal Multi-Task User Interface Modeling

The Versatile UI Transformer jointly models interface screenshots, structure, and language for five UI tasks. Its encoder supports element detection when structural metadata is absent, while an autoregressive component handles UI question answering and command grounding.

- Catalog URL: https://awesomecua.github.io/resources/arxiv-2112-05692/
- Original source: https://arxiv.org/abs/2112.05692
- Kind: paper
- Review: curated
- Scope: core
- Environments: unspecified
- Topics: screen-understanding, grounding, efficiency
- Evidence checked: 2026-10-16T06:42:42Z
- ID: arxiv:2112.05692

## Limitations

The annotation and scope were reviewed against the primary paper abstract. Experimental results and released artifacts have not been independently reproduced.

- Record JSON: https://awesomecua.github.io/resources/arxiv-2112-05692/record.json

## Authors

Yang Li, Gang Li, Xin Zhou, Mostafa Dehghani, Alexey Gritsenko

## Citation exports

- BibTeX: https://awesomecua.github.io/resources/arxiv-2112-05692/citation.bib
- CSL JSON: https://awesomecua.github.io/resources/arxiv-2112-05692/citation.csl.json

## Recorded arXiv snapshot

- Version: 1
- Version source: https://arxiv.org/abs/2112.05692v1
- First submission: 2021-12-10T17:37:26Z
- Version updated: 2021-12-10T17:37:26Z
- Abstract SHA-256: 6e88e6e2659df232174d9fc71a2fac61a021941f096355f8ea3cd4c618c223d3
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?id_list=2008.05132%2C2010.04295%2C2101.04893%2C2112.05692%2C2306.01242%2C2311.03079%2C2401.05459%2C2402.03746%2C2402.15506%2C2403.20329%2C2404.06395%2C2404.10179%2C2405.10292%2C2406.09187%2C2406.14596%2C2408.03326%2C2409.12089%2C2501.10893%2C2504.09352&max_results=19 (retrieved 2026-10-16T06:42:42Z; SHA-256 d1c1bc3fee56d124427abd2aabbcf876418633a8adf7a03f4ef0317cba6a42ae)
- https://export.arxiv.org/api/query?id_list=2008.05132%2C2010.04295%2C2101.04893%2C2112.05692%2C2306.01242%2C2311.03079%2C2401.05459%2C2402.03746%2C2402.15506%2C2403.20329%2C2404.06395%2C2404.10179%2C2405.10292%2C2406.09187%2C2406.14596%2C2408.03326%2C2409.12089%2C2501.10893%2C2504.09352&max_results=19 (retrieved 2026-10-16T06:42:42Z; SHA-256 d1c1bc3fee56d124427abd2aabbcf876418633a8adf7a03f4ef0317cba6a42ae)