Research papers

Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding

Introduces Screen Point-and-Read and a hierarchical layout approach that interprets screen regions indicated by a user-selected point.

AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.

Original source ↗Read as Markdown Record JSON

What is this resource?

Resource type: Research papers
Environment: cross-platform
Topics: screen-understanding, grounding
Record publication date: 2024-06-27
Evidence retrieved: 2026-10-16T06:31:32Z
Resource ID: arxiv:2406.19263

Recorded paper version

arXiv v2

Version updated: 2024-10-25T18:16:21Z.

This identifies the retained arXiv metadata snapshot; newly observed changes require separate review.

Abstract fingerprint

0c86d68b5c3486b099f64792d5d3290d79e25b7c82c6eb2402869b893bb22fea

Authors

Yue Fan, Lei Ding, Ching-Chen Kuo, Shan Jiang, Yang Zhao, Xinze Guan, Jie Yang, Yi Zhang, Xin Eric Wang

Cite this paper

Download BibTeX · Download CSL JSON

Citations preserve the selected source edition, its authors and recorded date precision. Unrecorded venues and identifiers are omitted.

Publication record

Title: Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding
Authors: Yue Fan, Lei Ding, Ching-Chen Kuo, Shan Jiang, Yang Zhao, Xinze Guan, Jie Yang, Yi Zhang, Xin Eric Wang
Publication date (recorded precision): 2024-11
Venue: Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Publisher: Association for Computational Linguistics
Pages: 9503-9522
DOI: 10.18653/v1/2024.emnlp-main.533

Publication source ↗ · Publisher or author PDF ↗

Publication BibTeX · Publication CSL JSON

This publication is a separately recorded edition of the same work. Its citation uses its own title, authors and date; the retained arXiv citation above is unchanged.

Date source: Explicit publisher citation_publication_date: 2024/11. Preserve supplied precision; do not substitute conference event dates.

Source notes: Publisher proceedings edition; retained separately from the arXiv snapshot.

Explore related topics

Screen understanding GUI grounding

Scope and limitations

The annotation and scope were reviewed against the primary paper abstract. Experimental results and released artifacts have not been independently reproduced.

Connected assets

These links come from reviewed resource records. A documentation link does not imply a training-data or evaluation dependency.

Documented resource: Screen Point-and-Read / Tree-of-Lens · Benchmarks · relationship evidence

Primary evidence and verification

Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.

arxiv api
Retrieved 2026-10-16T06:31:32Z. Supports: name, authors, published_at, updated_at, identifiers.arxiv, details.arxiv_snapshot.
Content fingerprint
b9a83994d8ac36ccdb606a5219511f8bb35ad3948ade4f9f3e28d386221aedfb
editorial primary review
Retrieved 2026-10-18T04:09:51Z. Supports: details.publication.authors, details.publication.date_basis, details.publication.date_parts, details.publication.doi, details.publication.identity_basis, details.publication.notes, details.publication.pages, details.publication.pdf_url, details.publication.publisher, details.publication.title, details.publication.type, details.publication.url, details.publication.venue.
Content fingerprint
1d105799f5db853e801090e8ed62273cd72dd3cb9b4060f901747aace8d2406d
editorial primary review
Retrieved 2026-10-16T06:31:32Z. Supports: name, kind, summary, environments, topics, scope, relations.
Content fingerprint
b9a83994d8ac36ccdb606a5219511f8bb35ad3948ade4f9f3e28d386221aedfb

Suggest a correction

Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.