CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents
Introduces CRAB, a framework for cross-environment agent tasks with graph-based evaluation and a benchmark spanning desktop and phone interactions.
AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.
What is this resource?
- Resource type
- Research papers
- Environment
- desktop, cross-platform
- Topics
- evaluation, cross-app
- Record publication date
- 2024-07-01
- Evidence retrieved
- 2026-10-16T06:31:32Z
- Resource ID
- arxiv:2407.01511
Recorded paper version
Version updated: 2025-07-20T13:42:07Z.
This identifies the retained arXiv metadata snapshot; newly observed changes require separate review.
Abstract fingerprint
12e5464ea0fc62bd566f19d301b887826b7ff317cfc27c86fa0cda8d3de271d9Authors
Tianqi Xu, Linyao Chen, Dai-Jie Wu, Yanjun Chen, Zecheng Zhang, Xiang Yao, Zhiqiang Xie, Yongchao Chen, Shilong Liu, Bochen Qian, Anjie Yang, Zhaoxuan Jin, Jianbo Deng, Philip Torr, Bernard Ghanem, Guohao Li
Cite this paper
Download BibTeX · Download CSL JSON
Citations preserve the selected source edition, its authors and recorded date precision. Unrecorded venues and identifiers are omitted.
Publication record
- Title
- CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents
- Authors
- Tianqi Xu, Linyao Chen, Dai-Jie Wu, Yanjun Chen, Zecheng Zhang, Xiang Yao, Zhiqiang Xie (谢志强), Yongchao Chen, Shilong Liu, Bochen Qian, Anjie Yang, Zhaoxuan Jin, Jianbo Deng, Philip Torr, Bernard Ghanem, Guohao Li
- Publication date (recorded precision)
- 2025-07
- Venue
- Findings of the Association for Computational Linguistics: ACL 2025
- Publisher
- Association for Computational Linguistics
- Pages
- 21607-21647
- DOI
- 10.18653/v1/2025.findings-acl.1113
Publication source ↗ · Publisher or author PDF ↗
Publication BibTeX · Publication CSL JSON
This publication is a separately recorded edition of the same work. Its citation uses its own title, authors and date; the retained arXiv citation above is unchanged.
Date source: Explicit publisher citation_publication_date: 2025/7. Preserve supplied precision; do not substitute conference event dates.
Source notes: Publisher proceedings edition; retained separately from the arXiv snapshot. Publisher spelling, initials, name annotations or author lists differ from the retained preprint.
Explore related topics
Scope and limitations
The annotation and scope were reviewed against the primary paper abstract. Experimental results and released artifacts have not been independently reproduced.
Connected assets
These links come from reviewed resource records. A documentation link does not imply a training-data or evaluation dependency.
- Documented resource: CRAB · Benchmarks · relationship evidence
Primary evidence and verification
Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.
- arxiv api
Retrieved 2026-10-16T06:31:32Z. Supports: name, authors, published_at, updated_at, identifiers.arxiv, details.arxiv_snapshot.
Content fingerprint
b9a83994d8ac36ccdb606a5219511f8bb35ad3948ade4f9f3e28d386221aedfb - editorial primary review
Retrieved 2026-10-18T04:09:51Z. Supports: details.publication.authors, details.publication.date_basis, details.publication.date_parts, details.publication.doi, details.publication.identity_basis, details.publication.notes, details.publication.pages, details.publication.pdf_url, details.publication.publisher, details.publication.title, details.publication.type, details.publication.url, details.publication.venue.
Content fingerprint
a8cf178f2faa088fd94b77d03785b8c6e2908db34b411287984066b4e5d1ef3f - editorial primary review
Retrieved 2026-10-16T06:31:32Z. Supports: name, kind, summary, environments, topics, scope, relations.
Content fingerprint
b9a83994d8ac36ccdb606a5219511f8bb35ad3948ade4f9f3e28d386221aedfb
Suggest a correction
Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.