Screen Point-and-Read / Tree-of-Lens

Screen-reading benchmark and Tree-of-Lens implementation for interpreting user-indicated regions and their layout context.

AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.

What is this resource?

Resource type

Benchmarks

Environment

cross-platform

Topics

screen-understanding, grounding, evaluation

Record publication date

Not recorded

Evidence retrieved

2026-10-16T10:43:11Z

Resource ID

github:ucsb-ai/screen-point-and-read

What licenses are recorded?

Code, training data, weights, and documents can have different terms. A blank declaration means unknown, not unrestricted use.

Code

MIT (repository LICENSE header; not a weights/data license)

Data

Not recorded

Document

Not recorded

Weights

Not recorded

Explore related topics

Scope and limitations

The canonical repository now belongs to UCSB-AI. Its README lists additional setup documentation and evaluation scripts as unfinished.

Related resources

• documented by: Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding

Primary evidence and verification

Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.

1. editorial primary review

   Retrieved 2026-10-16T10:43:11Z. Supports: name, kind, summary, environments, topics, scope, relations.

   Content fingerprint

   7567287ceee0ad2d3d5605abb44ac50463c1008f9b6309393695763cf2ce89bb
2. license header

   Retrieved 2026-10-16T10:48:42Z. Supports: licenses.code.

   Content fingerprint

   4748fb7d92f7a3a2a4a93353db96f6a2df547e5ea9ae87afa811c5423e96f363
3. github repository identity

   Retrieved 2026-10-17T14:14:01Z. Supports: aliases.

   Content fingerprint

   868e18717ff76355c6552a5629b15de9fed1add1262fa5801ecabd7a7fb333d4
4. github repository identity

   Retrieved 2026-10-17T14:14:02Z. Supports: aliases.

   Content fingerprint

   868e18717ff76355c6552a5629b15de9fed1add1262fa5801ecabd7a7fb333d4

Suggest a correction

Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.