# ScreenSuite

A shared evaluation harness for GUI-model perception, offline action prediction and multi-step interaction, using simple smolagents-based agents across existing benchmarks.

- Catalog URL: https://awesomecua.github.io/resources/github-huggingface-screensuite/
- Original source: https://github.com/huggingface/screensuite
- Kind: framework
- Review: curated
- Scope: core
- Environments: web, android, desktop
- Topics: evaluation, grounding, action-prediction
- Evidence checked: 2026-10-17T09:12:13Z
- ID: github:huggingface/screensuite

## Limitations

The publisher states that the suite compares the underlying multimodal models rather than full agent implementations. Public source includes benchmark adapters and registry code. Multi-step environments require Docker and KVM; constituent datasets, remote model services and OSWorld account-dependent tasks retain their own setup and terms. Apache-2.0 is scoped to this repository code.

- Record JSON: https://awesomecua.github.io/resources/github-huggingface-screensuite/record.json

## License declarations

- code: Apache-2.0 — https://raw.githubusercontent.com/huggingface/screensuite/HEAD/LICENSE
- data: not recorded
- document: not recorded
- weights: not recorded

- code review: Inspected repository LICENSE; not a license for linked benchmark datasets, pretrained weights or services.
  Sources: https://raw.githubusercontent.com/huggingface/screensuite/HEAD/LICENSE

## Primary evidence

- https://raw.githubusercontent.com/huggingface/screensuite/HEAD/README.md (retrieved 2026-10-17T09:12:13Z; SHA-256 edcaa6f8355be6a8774ebeeb9bdb67648e8eeddb813d6be0fa2433116d9def36)
- https://api.github.com/repos/huggingface/screensuite (retrieved 2026-10-17T09:12:12Z; SHA-256 e372458e48d0ebbbe0f7887b66e2d5bb4db612fd96db4dc53404c0319891f7e8)
- https://api.github.com/repos/huggingface/screensuite/git/trees/main?recursive=1 (retrieved 2026-10-17T09:14:05Z; SHA-256 93b685a13bfba4d9569dbfc0418de93c7b9f8a3f7c101af053aadeebbdf8b2c0)
- https://raw.githubusercontent.com/huggingface/screensuite/HEAD/LICENSE (retrieved 2026-10-17T09:14:06Z; SHA-256 c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4)