Benchmarks

ScreenSpot v2

Second version of the ScreenSpot grounding test set, published by OS-Copilot as separate desktop, mobile and web annotation files with a shared screenshot archive.

AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.

Original source ↗Read as Markdown Record JSON

What is this resource?

Resource type: Benchmarks
Environment: cross-platform
Topics: grounding, evaluation
Record publication date: Not recorded
Evidence retrieved: 2026-10-16T06:38:26Z
Resource ID: url:bd7214de6d98917c2350

What licenses are recorded?

Code, training data, weights, and documents can have different terms. A blank declaration means unknown, not unrestricted use.

Code: Not recorded
Data: apache-2.0 (publisher model/dataset card)
Document: Not recorded
Weights: Not recorded

Evaluation protocol

Focus: single-step GUI grounding on the ScreenSpot-v2 release
Setting: offline
Observations: screenshot, instruction
Actions / outputs: click coordinates
Evaluation: The inspected Jedi evaluation adapter reads the v2 mobile/desktop/web annotation files, scores a point against the target box, and reports overall, platform, and text/icon accuracy. This is a named compatible evaluator implementation; the OS-Atlas dataset card itself supplies no evaluator specification.

Scale and counting units

Not recorded

The public Hub revision 5efbb1f1 contains three platform JSON annotation files and an image ZIP; its card only declares Apache-2.0. No sample total or equivalence to the original ScreenSpot test count is asserted. Keep v2 separate from v1 and retain evaluator/version and coordinate conversion when comparing results. Files were listed, not downloaded as data.

Compare source-reviewed profiles

Recorded specifications

disabled: false
download url: https://huggingface.co/datasets/OS-Copilot/ScreenSpot-v2/tree/main
gated: false
hub id: OS-Copilot/ScreenSpot-v2
modalities: ["image"]

Explore related topics

GUI grounding Evaluation

Primary evidence and verification

Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.

editorial primary review
Retrieved 2026-10-16T06:38:26Z. Supports: name, kind, summary, environments, topics, scope, relations, details.benchmark_protocol.
Content fingerprint
7feddadc306e384f8df6a3d9c8afc0c776cb3734c4c7fe3eb842eab85537f408
editorial primary review
Retrieved 2026-10-17T14:22:05Z. Supports: details.benchmark_protocol.
Content fingerprint
94547cb88756cf6a36bfb86d5fe9bdca1e40d7edb9e452c33cb462bbe760fed0
editorial primary review
Retrieved 2026-10-17T14:21:09Z. Supports: details.benchmark_protocol.
Content fingerprint
0e8772bc8fd5a25c50d3c2f6b0caee05ed2ab4659d46d99d60adf2b5ab29e997
editorial primary review
Retrieved 2026-10-17T14:21:09Z. Supports: details.benchmark_protocol.
Content fingerprint
b85f5685ce6c200ea648471666177859693d7f40cf50c12d08765ae68580de4a
huggingface api
Retrieved 2026-10-16T06:38:26Z. Supports: details, licenses.data.
Content fingerprint
7feddadc306e384f8df6a3d9c8afc0c776cb3734c4c7fe3eb842eab85537f408

Suggest a correction

Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.