# TRISHUL: Towards Region Identification and Screen Hierarchy Understanding for Large VLM based GUI Agents

Combines hierarchical screen parsing with spatially enriched element descriptions to support both locating GUI targets and describing indicated elements.

- Catalog URL: https://awesomecua.github.io/resources/arxiv-2502-08226/
- Original source: https://arxiv.org/abs/2502.08226
- Kind: paper
- Review: curated
- Scope: core
- Environments: cross-platform
- Topics: grounding, screen-understanding
- Evidence checked: 2026-10-16T06:36:54Z
- ID: arxiv:2502.08226

## Limitations

The annotation and scope were reviewed against the primary paper abstract. Experimental results and released artifacts have not been independently reproduced.

- Record JSON: https://awesomecua.github.io/resources/arxiv-2502-08226/record.json

## Authors

Kunal Singh, Shreyas Singh, Mukund Khanna

## Citation exports

- BibTeX: https://awesomecua.github.io/resources/arxiv-2502-08226/citation.bib
- CSL JSON: https://awesomecua.github.io/resources/arxiv-2502-08226/citation.csl.json

## Recorded arXiv snapshot

- Version: 2
- Version source: https://arxiv.org/abs/2502.08226v2
- First submission: 2025-02-12T09:12:30Z
- Version updated: 2025-02-14T06:23:57Z
- Abstract SHA-256: a60d581e4318db66495a0333b864757ec896576c720e40da4a881f8740b9d9cf
- Abstract hash normalization: sha256-utf8-whitespace-collapsed-v1

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://export.arxiv.org/api/query?search_query=%28ti%3A%22computer+use%22+OR+ti%3A%22computer-use%22+OR+ti%3A%22GUI+agent%22+OR+ti%3A%22GUI+agents%22+OR+ti%3A%22GUI+grounding%22+OR+ti%3A%22web+agents%22+OR+ti%3A%22browser+agent%22%29+AND+submittedDate%3A%5B200001010000+TO+202610160636%5D&start=700&max_results=100&sortBy=submittedDate&sortOrder=descending (retrieved 2026-10-16T06:36:54Z; SHA-256 4953a8e0f029016aef668bce98cec4d2873a7ae49c1fe33c4311fa5eb8d24089)
- https://export.arxiv.org/api/query?search_query=%28ti%3A%22computer+use%22+OR+ti%3A%22computer-use%22+OR+ti%3A%22GUI+agent%22+OR+ti%3A%22GUI+agents%22+OR+ti%3A%22GUI+grounding%22+OR+ti%3A%22web+agents%22+OR+ti%3A%22browser+agent%22%29+AND+submittedDate%3A%5B200001010000+TO+202610160636%5D&start=700&max_results=100&sortBy=submittedDate&sortOrder=descending (retrieved 2026-10-16T06:36:54Z; SHA-256 4953a8e0f029016aef668bce98cec4d2873a7ae49c1fe33c4311fa5eb8d24089)