# Generalist Virtual Agents: A Survey on Autonomous Agents Across Digital Platforms

Surveys virtual agents for browsers, applications and operating systems, organizing prior work by task type, observation and action spaces, model strategies and evaluation methods. It examines screen-based interaction and keyboard, mouse and touch control, alongside transferability and long-sequence decision-making challenges.

- Catalog URL: https://awesomecua.github.io/resources/arxiv-2411-10943/
- Original source: https://arxiv.org/abs/2411.10943
- Kind: survey
- Review: curated
- Scope: core
- Environments: web, desktop, android, windows
- Topics: survey, web-navigation, mobile-navigation, evaluation, planning
- Evidence checked: 2026-10-18T04:29:13.577033+00:00
- ID: arxiv:2411.10943

## Limitations

Reviewed the complete retained arXiv abstract and exact-version official HTML sections on browser/application/OS environments, screen observations, input actions and evaluation. The HTML abstract fingerprint and ordered authors match the retained Atom entry. Literature claims and experiments were not independently reproduced.

- Record JSON: https://awesomecua.github.io/resources/arxiv-2411-10943/record.json

## Authors

Minghe Gao, Wendong Bu, Bingchen Miao, Yang Wu, Yunfei Li, Juncheng Li, Siliang Tang, Qi Wu, Yueting Zhuang, Meng Wang

## Citation exports

- BibTeX: https://awesomecua.github.io/resources/arxiv-2411-10943/citation.bib
- CSL JSON: https://awesomecua.github.io/resources/arxiv-2411-10943/citation.csl.json

## Recorded arXiv snapshot

- Version: 1
- Version source: https://arxiv.org/abs/2411.10943v1
- First submission: 2024-11-17T02:44:56Z
- Version updated: 2024-11-17T02:44:56Z
- Abstract SHA-256: daa9b7092616e94a1d0124d36d8b75d0401b9647ec762c963524616a92def9a5
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?id_list=2210.03347%2C2403.04984%2C2405.07090%2C2406.06282%2C2409.00088%2C2409.10811%2C2411.10943%2C2503.09241%2C2503.20279%2C2503.23350%2C2505.05440%2C2505.10593%2C2505.16422%2C2505.21279%2C2505.24878%2C2506.02153%2C2506.02839%2C2506.05079%2C2506.07976%2C2508.02046%2C2511.07885%2C2511.11248%2C2512.21720%2C2603.20351%2C2604.19299&max_results=25 (retrieved 2026-10-18T04:21:52Z; SHA-256 c194d15b7e422aae48b4e05216a1f1d84471b6666718b9d3dd4c9d250c356e77)
- https://arxiv.org/html/2411.10943v1 (retrieved 2026-10-18T04:29:13.577033+00:00; SHA-256 92f18020e481d6f42a6d35e96dff820594e9370597f5392d038e9ee908c49f1e)