Frameworks

ScreenSuite

A shared evaluation harness for GUI-model perception, offline action prediction and multi-step interaction, using simple smolagents-based agents across existing benchmarks.

AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.

Original source ↗Read as Markdown Record JSON

What is this resource?

Resource type: Frameworks
Environment: web, android, desktop
Topics: evaluation, grounding, action-prediction
Record publication date: Not recorded
Evidence retrieved: 2026-10-17T09:12:13Z
Resource ID: github:huggingface/screensuite

What licenses are recorded?

Code, training data, weights, and documents can have different terms. A blank declaration means unknown, not unrestricted use.

Code: Apache-2.0 (Inspected repository LICENSE; not a license for linked benchmark datasets, pretrained weights or services.)
Data: Not recorded
Document: Not recorded
Weights: Not recorded

License review notes

Code: Inspected repository LICENSE; not a license for linked benchmark datasets, pretrained weights or services. Source 1

Recorded specifications

availability: Public benchmark-adapter source and running instructions.
repository revision: 9ceda5070d5664dd9376d5f8e7b43f02188e01ff

Explore related topics

Evaluation GUI grounding Action prediction

Scope and limitations

The publisher states that the suite compares the underlying multimodal models rather than full agent implementations. Public source includes benchmark adapters and registry code. Multi-step environments require Docker and KVM; constituent datasets, remote model services and OSWorld account-dependent tasks retain their own setup and terms. Apache-2.0 is scoped to this repository code.

Primary evidence and verification

Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.

editorial primary review
Retrieved 2026-10-17T09:12:13Z. Supports: name, kind, summary, environments, topics, scope, notes, relations, details.
Content fingerprint
edcaa6f8355be6a8774ebeeb9bdb67648e8eeddb813d6be0fa2433116d9def36
editorial primary review
Retrieved 2026-10-17T09:12:12Z. Supports: identity.
Content fingerprint
e372458e48d0ebbbe0f7887b66e2d5bb4db612fd96db4dc53404c0319891f7e8
editorial primary review
Retrieved 2026-10-17T09:14:05Z. Supports: release_status.
Content fingerprint
93b685a13bfba4d9569dbfc0418de93c7b9f8a3f7c101af053aadeebbdf8b2c0
editorial primary review
Retrieved 2026-10-17T09:14:06Z. Supports: licenses.code.
Content fingerprint
c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4

Suggest a correction

Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.