WindowsWorld
Cross-application Windows benchmark with intermediate task evaluation.
AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.
What is this resource?
- Resource type
- Benchmarks
- Environment
- desktop, windows
- Topics
- evaluation, cross-app
- Record publication date
- Not recorded
- Evidence retrieved
- 2026-10-16T06:35:59Z
- Resource ID
- github:hitsz-tmg/windowsworld
What licenses are recorded?
Code, training data, weights, and documents can have different terms. A blank declaration means unknown, not unrestricted use.
- Code
- Apache-2.0 (repository LICENSE header; not a weights/data license)
- Data
- Not recorded
- Document
- Not recorded
- Weights
- Not recorded
Evaluation protocol
- Focus
- multi-application Windows workflows, intermediate-state and final-goal completion
- Setting
- interactive
- Observations
- screenshot, accessibility tree, screenshot plus accessibility tree, set-of-marks
- Actions / outputs
- PyAutoGUI, UiPath Computer_13 action interface
- Evaluation
- Publisher distinguishes S_int (intermediate checkpoint score on L1–L3) and S_final (final completion on L1–L4). Documented step budgets are 15/25/40/20 for L1/L2/L3/L4. Preserve level, observation mode, agent interface and checkpoint/final metric when reporting a run.
Scale and counting units
- 181 tasks — WindowsWorld benchmark described in the retained README source
- 17 desktop applications — WindowsWorld coverage described in the retained README source
Interactive VMware/Windows environment. The public repository includes benchmark.json, task/evaluator code and monitoring support; the README refers VM import to Installation Guide.md, whose distribution links and payloads were not inspected for this profile. Checkpoint counts and application counts are not extra tasks. Apache-2.0 is recorded for repository code; Windows, apps and VM artifacts retain separate terms.
Compare source-reviewed profiles
Explore related topics
Related resources
- documented by: WindowsWorld: A Process-Centric Benchmark of Autonomous GUI Agents in Professional Cross-Application Environments
Primary evidence and verification
Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.
- editorial primary review
Retrieved 2026-10-16T06:35:59Z. Supports: name, kind, summary, environments, topics, scope, relations, details.benchmark_protocol.
Content fingerprint
9857bd8ae9f521f152761ae3bd85debe4e7471aad34c9eb47618332948bca6c9 - editorial primary review
Retrieved 2026-10-17T14:14:05Z. Supports: details.benchmark_protocol.
Content fingerprint
490c9257d56f0a5214e6424e02490379b0b00ca2f7d4626fd5d14e17239d05ed - license header
Retrieved 2026-10-16T06:41:59Z. Supports: licenses.code.
Content fingerprint
a8d1d88a0f9cce3cdbff73b03a80dc5e5d69e3ba2443946c268815a550c9e0ec
Suggest a correction
Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.