# AutoEval: A Practical Framework for Autonomous Evaluation of Mobile Agents

Generates reward signals from UI-state changes and uses a judging system to evaluate mobile agents with reduced manual evaluator construction.

- Catalog URL: https://awesomecua.github.io/resources/arxiv-2503-02403/
- Original source: https://arxiv.org/abs/2503.02403
- Kind: paper
- Review: curated
- Scope: core
- Environments: unspecified
- Topics: evaluation, mobile-navigation
- Evidence checked: 2026-10-16T06:45:04Z
- ID: arxiv:2503.02403

## Limitations

The annotation and scope were reviewed against the primary paper abstract. Experimental results and released artifacts have not been independently reproduced.

- Record JSON: https://awesomecua.github.io/resources/arxiv-2503-02403/record.json

## Authors

Jiahui Sun, Zhichao Hua, Yubin Xia

## Citation exports

- BibTeX: https://awesomecua.github.io/resources/arxiv-2503-02403/citation.bib
- CSL JSON: https://awesomecua.github.io/resources/arxiv-2503-02403/citation.csl.json

## Recorded arXiv snapshot

- Version: 2
- Version source: https://arxiv.org/abs/2503.02403v2
- First submission: 2025-03-04T08:44:30Z
- Version updated: 2025-09-24T05:11:34Z
- Abstract SHA-256: a0c393d109ab0f8da2bf25bb39581236babd50f7554f2ec99679a99fb7215171
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?id_list=2303.17760%2C2310.03720%2C2312.11190%2C2403.02502%2C2406.12639%2C2409.18060%2C2410.00201%2C2501.01702%2C2501.11425%2C2502.02533%2C2502.02955%2C2502.12110%2C2502.15760%2C2502.17110%2C2502.19328%2C2503.02197%2C2503.02403%2C2503.02682%2C2503.06580%2C2503.07365%2C2503.09572%2C2503.14021%2C2503.24180%2C2504.02357%2C2504.11675%2C2504.13936&max_results=26 (retrieved 2026-10-16T06:45:04Z; SHA-256 bab88dfed88ca440c231aa768530374a0f19498777a70921481a904fddd46bb8)
- https://export.arxiv.org/api/query?id_list=2303.17760%2C2310.03720%2C2312.11190%2C2403.02502%2C2406.12639%2C2409.18060%2C2410.00201%2C2501.01702%2C2501.11425%2C2502.02533%2C2502.02955%2C2502.12110%2C2502.15760%2C2502.17110%2C2502.19328%2C2503.02197%2C2503.02403%2C2503.02682%2C2503.06580%2C2503.07365%2C2503.09572%2C2503.14021%2C2503.24180%2C2504.02357%2C2504.11675%2C2504.13936&max_results=26 (retrieved 2026-10-16T06:45:04Z; SHA-256 bab88dfed88ca440c231aa768530374a0f19498777a70921481a904fddd46bb8)