# ClickAgent: Enhancing UI Location Capabilities of Autonomous Agents

Separates multimodal reasoning and action planning from a dedicated UI localization model, with evaluation on Android devices.

- Catalog URL: https://awesomecua.github.io/resources/arxiv-2410-11872/
- Original source: https://arxiv.org/abs/2410.11872
- Kind: paper
- Review: curated
- Scope: core
- Environments: android
- Topics: mobile-navigation, grounding
- Evidence checked: 2026-10-16T06:31:35Z
- ID: arxiv:2410.11872

## Limitations

The annotation and scope were reviewed against the primary paper abstract. Experimental results and released artifacts have not been independently reproduced.

- Record JSON: https://awesomecua.github.io/resources/arxiv-2410-11872/record.json

## Authors

Jakub Hoscilowicz, Bartosz Maj, Bartosz Kozakiewicz, Oleksii Tymoshchuk, Artur Janicki

## Citation exports

- BibTeX: https://awesomecua.github.io/resources/arxiv-2410-11872/citation.bib
- CSL JSON: https://awesomecua.github.io/resources/arxiv-2410-11872/citation.csl.json

## Publication record

- Title: ClickAgent: Enhancing UI Location Capabilities of Autonomous Agents
- Authors: Jakub Hoscilowicz, Bartosz Maj, Bartosz Kozakiewicz, Oleksii Tymoshchuk, Artur Janicki
- Publication date (recorded precision): 2025-08
- Publication source: https://aclanthology.org/2025.sigdial-1.38/
- Publication BibTeX: https://awesomecua.github.io/resources/arxiv-2410-11872/publication-citation.bib
- Publication CSL JSON: https://awesomecua.github.io/resources/arxiv-2410-11872/publication-citation.csl.json
- venue: Proceedings of the 26th Annual Meeting of the Special Interest Group on Discourse and Dialogue
- publisher: Association for Computational Linguistics
- pages: 471-476
- doi: 10.18653/v1/2025.sigdial-1.38
- date basis: Explicit publisher citation_publication_date: 2025/8. Preserve supplied precision; do not substitute conference event dates.
- identity basis: Same work: normalized title, ordered author correspondence and the specific contribution in the complete publisher abstract were reviewed against the retained arXiv identity. The publisher PDF title and complete first-page author list were visually checked.
- notes: Publisher proceedings edition; retained separately from the arXiv snapshot. Publisher spelling, initials, name annotations or author lists differ from the retained preprint. Authors follow the five-author list on page 1 of the publisher PDF. Landing-page citation metadata lists only Jakub Hoscilowicz and Artur Janicki.
- Publication evidence: https://aclanthology.org/2025.sigdial-1.38/, https://aclanthology.org/2025.sigdial-1.38.pdf

## Recorded arXiv snapshot

- Version: 2
- Version source: https://arxiv.org/abs/2410.11872v2
- First submission: 2024-10-09T14:49:02Z
- Version updated: 2024-10-17T07:12:31Z
- Abstract SHA-256: e804944da205076ac6cf88c7966c471697e526f657bda339e09df240257f7217
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?id_list=2410.00467%2C2410.00689%2C2410.02810%2C2410.02907%2C2410.05243%2C2410.06703%2C2410.08164%2C2410.09006%2C2410.09024%2C2410.11843%2C2410.11871%2C2410.11872%2C2410.13232%2C2410.13757%2C2410.13824%2C2410.13825%2C2410.13886%2C2410.14803%2C2410.15164%2C2410.16464%2C2410.17236%2C2410.17401%2C2410.17520%2C2410.17883%2C2410.18603%2C2410.18963%2C2410.18967%2C2410.19054%2C2410.19100%2C2410.19461%2C2410.19609%2C2410.20745%2C2410.22552%2C2410.23218%2C2410.24024%2C2411.00820%2C2411.02337%2C2411.02391%2C2411.04468%2C2411.04890%2C2411.06559%2C2411.07618%2C2411.10323%2C2411.13451%2C2411.13591%2C2411.15004%2C2411.17465%2C2411.18279%2C2412.00402%2C2412.01268&max_results=50 (retrieved 2026-10-16T06:31:35Z; SHA-256 b3e67984f59a1b05ccd946eb54e2d37b0bb78ab0ca796fbb6d544793dafea3e0)
- https://aclanthology.org/2025.sigdial-1.38/ (retrieved 2026-10-18T04:09:53Z; SHA-256 7c710272d48754149cc5947f5382b8123eac5855db7655410259c4a3129b8b5b)
- https://aclanthology.org/2025.sigdial-1.38.pdf (retrieved 2026-10-18T04:14:09.676954+00:00; SHA-256 c5b5cd07e3ca2f2911e183c4752e01c721971c47fd20c836605452f2b80e5260)
- https://export.arxiv.org/api/query?id_list=2410.00467%2C2410.00689%2C2410.02810%2C2410.02907%2C2410.05243%2C2410.06703%2C2410.08164%2C2410.09006%2C2410.09024%2C2410.11843%2C2410.11871%2C2410.11872%2C2410.13232%2C2410.13757%2C2410.13824%2C2410.13825%2C2410.13886%2C2410.14803%2C2410.15164%2C2410.16464%2C2410.17236%2C2410.17401%2C2410.17520%2C2410.17883%2C2410.18603%2C2410.18963%2C2410.18967%2C2410.19054%2C2410.19100%2C2410.19461%2C2410.19609%2C2410.20745%2C2410.22552%2C2410.23218%2C2410.24024%2C2411.00820%2C2411.02337%2C2411.02391%2C2411.04468%2C2411.04890%2C2411.06559%2C2411.07618%2C2411.10323%2C2411.13451%2C2411.13591%2C2411.15004%2C2411.17465%2C2411.18279%2C2412.00402%2C2412.01268&max_results=50 (retrieved 2026-10-16T06:31:35Z; SHA-256 b3e67984f59a1b05ccd946eb54e2d37b0bb78ab0ca796fbb6d544793dafea3e0)