OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
Introduces a real-computer evaluation environment with execution-based checks for tasks spanning desktop applications and operating-system state.
AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.
What is this resource?
- Resource type
- Research papers
- Environment
- desktop, linux, windows, macos
- Topics
- evaluation, cross-app
- Record publication date
- 2024-04-11
- Evidence retrieved
- 2026-10-16T06:31:28Z
- Resource ID
- arxiv:2404.07972
Recorded paper version
Version updated: 2024-05-30T08:55:12Z.
This identifies the retained arXiv metadata snapshot; newly observed changes require separate review.
Abstract fingerprint
a347bfcb4de03a60410392b52d522e5b7ad5dbabb474d60fc1ec097e74c4008dAuthors
Tianbao Xie, Danyang Zhang, Jixuan Chen, Xiaochuan Li, Siheng Zhao, Ruisheng Cao, Toh Jing Hua, Zhoujun Cheng, Dongchan Shin, Fangyu Lei, Yitao Liu, Yiheng Xu, Shuyan Zhou, Silvio Savarese, Caiming Xiong, Victor Zhong, Tao Yu
Cite this paper
Download BibTeX · Download CSL JSON
Citations preserve the selected source edition, its authors and recorded date precision. Unrecorded venues and identifiers are omitted.
Publication record
- Title
- OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
- Authors
- Tianbao Xie, Danyang Zhang, Jixuan Chen, Xiaochuan Li, Siheng Zhao, Ruisheng Cao, Toh J. Hua, Zhoujun Cheng, Dongchan Shin, Fangyu Lei, Yitao Liu, Yiheng Xu, Shuyan Zhou, Silvio Savarese, Caiming Xiong, Victor Zhong, Tao Yu
- Publication date (recorded precision)
- 2024-12-16
- Venue
- Advances in Neural Information Processing Systems
- Volume
- 37
- Pages
- 52040-52094
- DOI
- 10.52202/079017-1650
Publication source ↗ · Publisher or author PDF ↗
Publication BibTeX · Publication CSL JSON
This publication is a separately recorded edition of the same work. Its citation uses its own title, authors and date; the retained arXiv citation above is unchanged.
Date source: Explicit publisher citation_publication_date: 2024-12-16. Preserve supplied precision; do not substitute conference event dates.
Source notes: Publisher proceedings edition; retained separately from the arXiv snapshot. Publisher spelling, initials, name annotations or author lists differ from the retained preprint.
Explore related topics
Scope and limitations
Editorial summary based on the primary paper abstract; experiments and released artifacts have not been independently reproduced.
Connected assets
These links come from reviewed resource records. A documentation link does not imply a training-data or evaluation dependency.
- Documented resource: OSWorld · Benchmarks · relationship evidence
Primary evidence and verification
Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.
- arxiv api
Retrieved 2026-10-16T06:31:28Z. Supports: name, authors, published_at, updated_at, identifiers.arxiv, details.arxiv_snapshot.
Content fingerprint
be244bfae7f89ef9449b69d85aac44295eb7b5f7e5e1bbedd76df312696676a7 - editorial primary review
Retrieved 2026-10-18T04:10:02Z. Supports: details.publication.authors, details.publication.date_basis, details.publication.date_parts, details.publication.doi, details.publication.identity_basis, details.publication.notes, details.publication.pages, details.publication.pdf_url, details.publication.title, details.publication.type, details.publication.url, details.publication.venue, details.publication.volume.
Content fingerprint
f62cbd2e5c92d250cc894a05e46f9052cfd38f0cdbf14902af6a96b96bcc9e8d - editorial primary review
Retrieved 2026-10-16T06:31:28Z. Supports: name, kind, summary, environments, topics, scope, relations.
Content fingerprint
be244bfae7f89ef9449b69d85aac44295eb7b5f7e5e1bbedd76df312696676a7
Suggest a correction
Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.