Online Mind2Web
300 tasks on 136 live websites for evaluating web agents online, with outdated tasks replaced over time, human-reviewed submissions and the WebJudge automatic evaluator.
AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.
What is this resource?
- Resource type
- Benchmarks
- Environment
- web
- Topics
- evaluation, web-navigation
- Record publication date
- Not recorded
- Evidence retrieved
- 2026-10-16T06:35:57Z
- Resource ID
- github:osu-nlp-group/online-mind2web
What licenses are recorded?
Code, training data, weights, and documents can have different terms. A blank declaration means unknown, not unrestricted use.
- Code
- MIT (repository LICENSE header; not a weights/data license)
- Data
- Not recorded
- Document
- Not recorded
- Weights
- Not recorded
Evaluation protocol
- Focus
- live-web task completion
- Setting
- interactive
- Observations
- Not recorded
- Actions / outputs
- web interactions
- Evaluation
- Human evaluation and WebJudge-based evaluation are documented as distinct assessment paths.
Scale and counting units
Tasks are actively replaced when websites or requirements become invalid. Record the task revision and submission schema; a constant headline task count does not imply an unchanged test set.
Compare source-reviewed profiles
Recorded specifications
- leaderboard url
- https://huggingface.co/spaces/osunlp/Online_Mind2Web_Leaderboard
Explore related topics
Primary evidence and verification
Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.
- editorial primary review
Retrieved 2026-10-16T06:35:57Z. Supports: name, kind, summary, environments, topics, scope, relations, details.benchmark_protocol, details.leaderboard_url.
Content fingerprint
49d7cc317fd2ba0df65abf65a0357d1fa2384e59019a96d4e24b784888599eaa - license header
Retrieved 2026-10-16T06:41:57Z. Supports: licenses.code.
Content fingerprint
93675f9d13697ae98889d703b8fae86a7200623e7ae8d844c9ee2200ad480583
Suggest a correction
Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.