Benchmarks

MMBench-GUI

Four-level GUI-agent benchmark across six platforms, from content understanding and element grounding to task automation and collaboration, scored with an efficiency-quality area metric.

AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.

Original source ↗Read as Markdown Record JSON

What is this resource?

Resource type: Benchmarks
Environment: cross-platform
Topics: evaluation, grounding
Record publication date: Not recorded
Evidence retrieved: 2026-10-16T06:35:58Z
Resource ID: github:open-compass/mmbench-gui

What licenses are recorded?

Code, training data, weights, and documents can have different terms. A blank declaration means unknown, not unrestricted use.

Code: Not recorded
Data: Not recorded
Document: Not recorded
Weights: Not recorded

Evaluation protocol

Focus: screen understanding, grounding, task automation, task collaboration
Setting: mixed
Observations: screenshots
Actions / outputs: Not recorded
Evaluation: Level-specific evaluation; Efficiency–Quality Area (EQA) combines navigation quality and efficiency.

Scale and counting units

> 8,000 tasks — reported multi-level benchmark source

The README documents four levels, but its release notes and TODOs distinguish released L1/L2 evaluation from pending L3/L4 integration. Do not treat every level as the same evaluator or a complete implemented interface.

Compare source-reviewed profiles

Explore related topics

Evaluation GUI grounding

Related resources

documented by: MMBench-GUI: Hierarchical Multi-Platform Evaluation Framework for GUI Agents

Primary evidence and verification

Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.

editorial primary review
Retrieved 2026-10-16T06:35:58Z. Supports: name, kind, summary, environments, topics, scope, relations, details.benchmark_protocol.
Content fingerprint
35db9fca3ed1c1a3513924fefff4ccd224bc70cd7eb4bf8c54fcb9048851988e

Suggest a correction

Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.