# PerPilot: Personalizing VLM-based Mobile Agents via Memory and Exploration

Introduces PerPilot and the PerInstruct dataset for completing user-specific mobile instructions through memory retrieval, app exploration, and clarification when missing context remains unresolved.

- Catalog URL: https://awesomecua.github.io/resources/arxiv-2508-18040/
- Original source: https://arxiv.org/abs/2508.18040
- Kind: paper
- Review: curated
- Scope: core
- Environments: unspecified
- Topics: memory, planning, human-in-the-loop, mobile-navigation
- Evidence checked: 2026-10-18T10:01:10.946679+00:00
- ID: arxiv:2508.18040

## Limitations

Personalization depends on the validity of stored or inferred user information and retrieval access. This is instruction completion with interaction, not demonstrated permanent model-weight personalization. No specific operating system or reproduced result is asserted. Basis: complete retained abstract and source-reviewed sections of the exact-version paper (The Framework of PerPilot; Personalization Perception; Personalization Completion; PerInstruct Data Construction); not an entire-paper reading or reproduction claim.

- Record JSON: https://awesomecua.github.io/resources/arxiv-2508-18040/record.json

## Authors

Xin Wang, Zhiyao Cui, Hao Li, Ya Zeng, Chenxu Wang, Ruiqi Song, Yihang Chen, Kun Shao, Qiaosheng Zhang, Jinzhuo Liu, Siyue Ren, Shuyue Hu, Zhen Wang

## Citation exports

- BibTeX: https://awesomecua.github.io/resources/arxiv-2508-18040/citation.bib
- CSL JSON: https://awesomecua.github.io/resources/arxiv-2508-18040/citation.csl.json

## Recorded arXiv snapshot

- Version: 1
- Version source: https://arxiv.org/abs/2508.18040v1
- First submission: 2025-08-25T13:57:02Z
- Version updated: 2025-08-25T13:57:02Z
- Abstract SHA-256: 57d5fc98a2eb2232f237d71b34060df0acef89cfeaa4bc247580a4dda3223e0b
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?search_query=%28ti%3A%22computer+use%22+OR+ti%3A%22computer-use%22+OR+ti%3A%22GUI+agent%22+OR+ti%3A%22GUI+agents%22+OR+ti%3A%22GUI+grounding%22+OR+ti%3A%22web+agents%22+OR+ti%3A%22browser+agent%22+OR+ti%3A%22mobile+agent%22+OR+ti%3A%22UI+agent%22+OR+ti%3A%22desktop+agent%22+OR+ti%3A%22screen+grounding%22%29+AND+submittedDate%3A%5B200001010000+TO+202610180000%5D&start=600&max_results=100&sortBy=submittedDate&sortOrder=descending (retrieved 2026-10-18T10:01:10.946679+00:00; SHA-256 594b5261dd2039777d36c46cdb8525d973ad57a154b902ff1a171bcbed2c64cc)
- https://export.arxiv.org/api/query?search_query=%28ti%3A%22computer+use%22+OR+ti%3A%22computer-use%22+OR+ti%3A%22GUI+agent%22+OR+ti%3A%22GUI+agents%22+OR+ti%3A%22GUI+grounding%22+OR+ti%3A%22web+agents%22+OR+ti%3A%22browser+agent%22+OR+ti%3A%22mobile+agent%22+OR+ti%3A%22UI+agent%22+OR+ti%3A%22desktop+agent%22+OR+ti%3A%22screen+grounding%22%29+AND+submittedDate%3A%5B200001010000+TO+202610180000%5D&start=600&max_results=100&sortBy=submittedDate&sortOrder=descending (retrieved 2026-10-18T10:01:10.946679+00:00; SHA-256 594b5261dd2039777d36c46cdb8525d973ad57a154b902ff1a171bcbed2c64cc)
- https://arxiv.org/pdf/2508.18040v1 (retrieved 2026-10-18T10:18:36.598801+00:00; SHA-256 3c3474b771af7bdd500e6aaa91b83d39ec0d455e59bb83df906e7a94700ad2b7)