SOURCE-REVIEWED COMPARISON

Compare GUI-agent training datasets

Match supervision, modalities, data format, splits, and license to the training objective you need.

66 profiles are available among 86 reviewed datasets in the catalog. Remaining entries are available in the full directory. Missing values mean not recorded.

Counts retain their units and subsets; figures are publisher-reported unless marked computed. Different resources can describe parts of the same project.

Showing 66 of 66 profiles.

Scroll the table sideways to see all columns.

Resource / supervisionModalities / formatSplits / data licenseScale with scope
AgentNet
desktop

computer-use trajectories, synthesized reasoning

screenshots, instructions, actions, generated reasoning
Format
JSONL, image archives
Not recorded
Data license
mit
  • ≈ 22,600 tasks — AgentNet collection source
Scope and source notes

The card distinguishes human task instructions from generated summaries, reasoning, reflections, and quality fields. Generated labels are not independent human quality acceptance records.

AgentSynth tasks and trajectories
desktop, web

synthetic tasks, agent trajectories

screenshots, task instructions, LLM thoughts, commands
Format
JSONL, ZIP trajectory packages
train (osworld configuration), train (insta configuration)
Data license
Apache-2.0
  • > 6,000 tasks — collection described in the dataset card; not an independently counted release-row total source
Scope and source notes

Card maps osworld/train to all_tasks.jsonl and insta/train to task_sequences.jsonl. Six difficulty levels and trajectory screenshots/thoughts/commands are documented. ZIP file labels are not trajectory counts; configurations and composed-task levels are not assumed disjoint.

Aguvis stage 1 grounding data
cross-platform

GUI grounding supervised fine-tuning

GUI screenshots, grounding annotations
Format
JSON annotations, ZIP image packages, multipart TAR image packages
training
Data license
apache-2.0
Not recorded
Scope and source notes

Stage 1 grounding release, Hub revision 5d11f8f5. JSON annotations and ZIP/multipart TAR image packages are publicly listed. The official training configuration groups web, desktop and mobile inputs and selects all rows of its configured inputs; this is a training recipe, not a release sample count or held-out split. The config names omniact.json while the Hub manifest lists omniact_fix.json, so local paths need reconciliation. No sample total is inferred from names such as webui350k. Apache-2.0 is the release card declaration; upstream source rights remain separate.

Aguvis stage 2 trajectory data
cross-platform

GUI trajectory supervised fine-tuning, planning and reasoning with inner monologue

GUI screenshots, natural-language instructions, action trajectories
Format
JSON annotations, ZIP image packages, multipart TAR image packages
training
Data license
apache-2.0
Not recorded
Scope and source notes

Stage 2 trajectory release, Hub revision bd6f1ed4, is distinct from Stage 1 grounding. The public manifest lists source-specific JSON levels and image ZIP/multipart TAR packages. The training recipe uses all rows for some inputs and random:33% for others; several l2 paths occur twice while the manifest also contains l3 files. Recipe rows/levels are neither independent datasets nor disjoint train/test splits. No example/action/trajectory count is inferred. Apache-2.0 is the card declaration, with separate underlying source terms.

AMEX
android

element grounding, UI functionality, interaction trajectories

screenshots, element annotations, functionality descriptions, action chains
Format
Not recorded
Not recorded
Data license
Not recorded
  • > 104,000 screenshots — AMEX collection described in the paper source
Scope and source notes

The main repository contains companion training code. The scale and annotation levels here come from the paper, not an independent download or completeness audit.

Android in the Wild
android

interaction trajectories, action prediction

screenshots, instructions, actions
Format
GZIP-compressed TFRecord
Not recorded
Data license
Not recorded
  • 715,142 episodes — sum of the five published AitW subsets source
  • 5,689,993 action examples — sum of the five published AitW subsets source
Scope and source notes

Episodes and action examples are different units. The collection combines multi-step subsets and hindsight-labeled single-step tasks; preserve subset and split choices.

AndroidCode
android

action-conditioned next-state code prediction, generated HTML supervision

GUI screenshots (described input), GUI actions, HTML
Format
HTML, JSON, Python extraction/loading scripts
Android-Control train file, Android-Control test file
Data license
MIT
  • > 80,000 screen–action pairs — AndroidCode corpus described by Code2World README; released JSON rows not recounted source
Scope and source notes

The manifest lists 58,953 HTML files, which are not converted into transition/example counts. The reported >80k pairs and the HTML-file inventory have different units. The card itself has no sample schema or count; archive/image completeness and JSON contents were not audited.

AndroidControl
android

interaction trajectories, high- and low-level action instruction

screenshots, accessibility trees, instructions, JSON actions
Format
GZIP-compressed TFRecord
publisher split file
Data license
Not recorded
  • > 15,000 demonstrations — AndroidControl collection source
  • 833 applications — AndroidControl collection source
Scope and source notes

Step instructions can be repeated across multiple actions. Each episode has one more screenshot than action; do not count repeated step instructions as independent task goals.

Aria-UI Context-aware Data
android

context-aware grounding

screen observations, instructions, interaction history
Format
Not recorded
Not recorded
Data license
apache-2.0
  • ≈ 992,000 instruction-output pairs — context-aware episode training release source
Scope and source notes

The Hub card contains only licensing metadata. The project README supports the episode-training description and rounded count; archive-level quality and exact row counts remain unverified.

Aria-UI Data
web, android, desktop, linux

element grounding, element descriptions

screenshots, instructions, element captions
Format
JSON annotations, image archives
Not recorded
Data license
apache-2.0
  • ≈ 2,900,000 instructions — web subset source
  • ≈ 173,000 images — web subset source
  • ≈ 1,100,000 instructions — mobile subset source
  • ≈ 104,000 images — mobile subset source
  • ≈ 150,000 instructions — desktop subset source
  • ≈ 7,800 images — desktop subset source
Scope and source notes

The card identifies deprecated desktop files with screenshot-mapping errors and names corrected releases. Counts are rounded publisher figures for separate platform subsets; instructions and images are not interchangeable.

AutoDroid V2 training data
android

supervised conversations for AutoDroid-V2 fine-tuning

text
Format
JSON in ShareGPT conversation format
Not recorded
Data license
mit
Not recorded
Scope and source notes

The card has license metadata only. The project training README supplies formatting and purpose. No sample count or split inventory is inferred from the training configuration.

AutoGUI v1 training data
web, cross-platform

element grounding, functionality captioning

screenshots, instructions, functionality labels, bounding boxes
Format
Not recorded
train
Data license
cc-by-4.0
  • 701,864 training rows — default/train in the dataset card metadata source
Scope and source notes

Rows are not unique screenshots. The card documents image-downscaling conventions that affect coordinates; preserve the device and original image-size fields.

Dreamer V1 Data
web

web-world-model prediction

images, prompts, actions, responses
Format
Not recorded
Not recorded
Data license
cc-by-nc-sa-4.0
Not recorded
Scope and source notes

The card reports a cleaned size of 3.12M without defining the counting unit, so no sample total is inferred. The data card declares noncommercial share-alike terms, separately from the model-weight license.

Go-Browse-WA processed data
web

action completion, trajectory outcome

text, accessibility-tree observations, actions
Format
Parquet
train
Data license
Not recorded
  • 164,533 step records — train split source
Scope and source notes

The card count is flattened step records, not trajectories or independent tasks. Both successful and unsuccessful trajectories are included according to the project README; no license is declared.

GroundGUI RL Dataset
desktop

instruction-to-click grounding, target bounding boxes

screenshots, text, coordinates
Format
Parquet
train
Data license
mit
  • 12,600 prompts — RL training corpus source
  • 11,205 screenshots — RL training corpus source
  • 87 desktop applications — RL training corpus source
Scope and source notes

Publisher-reported counts cover a selection and reformatting of GroundCUA, not a new disjoint image collection. No independent image-overlap audit was performed.

GUI-Action Narrator
cross-platform

GUI action captioning

GUI video, action captions
Format
Not recorded
Not recorded
Data license
Not recorded
  • 4,189 video-captioning samples — Act2Cap benchmark described in the paper source
Scope and source notes

A captioning sample is not necessarily a unique video or complete task trajectory. Package layout and split sizes were not established by the inspected sources.

GUI-Actor data
unspecified

GUI grounding with bounding-box supervision

GUI screenshots, bounding boxes, grounding annotations
Format
JSON annotations, ZIP image packages, multipart image archives
training
Data license
Not recorded
Not recorded
Scope and source notes

Public Hub revision 5a0b35fb includes six bbox JSON files and associated image archives. The training configuration names six input paths with sampling_strategy=all; those input paths are not six disjoint datasets or a verified example count. The card’s source-list wording and mismatched hyperlinks remain unresolved, so its approximately 1M screenshots/10M elements headline is not adopted as a release inventory. No data license is established by the card, and the model repository license is not transferred to these data.

GUI-CIDER causal knowledge data
android

synthesized static planning knowledge, synthesized dynamic causal knowledge

text
Format
JSONL
Not recorded
Data license
Not recorded
Not recorded
Scope and source notes

Purpose is established by the official project, not by API tags. No sample records were downloaded; count and data-license fields remain unknown.

GUI-Net-1M
unspecified

GUI trajectory supervision from multimodal tutorials

text, screenshots
Format
JSON annotations, multipart image archives
training collection
Data license
apache-2.0
  • ≈ 1,000,000 training trajectories — TongUI-collected GUI-Net-1M data, excluding added external mixtures source
Scope and source notes

The source reports an approximate trajectory total; it does not establish per-platform counts or a complete test-split inventory.

GUI-Odyssey
android

cross-app trajectories, action grounding

screenshots, instructions, actions, bounding boxes, step context
Format
JSON annotations, PNG screenshots
random, task, device, app
Data license
Not recorded
  • 8,334 episodes — recommended hflqf88888/GUIOdyssey release source
Scope and source notes

The repository gives conflicting episode totals (8,334 and 8,834). This profile uses 8,334 from the specifically recommended current dataset card. No independent archive recount was performed. Coordinates are normalized to 0–1000.

GUI-World
cross-platform

GUI video question answering, temporal interface understanding

videos, frame images, text
Format
Not recorded
train, test
Data license
Not recorded
  • 6 GUI scenario categories — dataset taxonomy source
  • 8 question types — dataset taxonomy source
Scope and source notes

Taxonomy counts describe coverage, not the number of videos or questions. Cases include Android, iOS, desktop software, websites, multi-application use, and XR. Keyframe-selection settings affect evaluation; exact sample inventories are not reported here.

GUIAct
web, android

single-step actions, multi-step navigation

screenshots, instructions, actions
Format
JSON, Parquet
train, test
Data license
Not recorded
  • ≈ 67,000 action instructions — single-step portion source
  • ≈ 15,000 action instructions — multi-step portion source
Scope and source notes

Quantities are rounded publisher descriptions, not downloaded sample counts. Data-license declarations conflict across first-party sources; no permissive license is inferred.

GUIChat
unspecified

single-turn question answering, multi-turn dialogue

screenshots, text, bounding boxes
Format
JSON, Parquet
Not recorded
Data license
Not recorded
  • ≈ 44,000 QA pairs — single-turn portion source
  • ≈ 6,000 dialogues — multi-turn portion source
Scope and source notes

Quantities are rounded publisher descriptions, not downloaded sample counts. Data-license declarations conflict across first-party sources; no permissive license is inferred.

GUIEnv-local
web

OCR, region-text grounding

screenshots, text, bounding boxes
Format
JSON, Parquet
train, test
Data license
Not recorded
  • ≈ 700,000 region-text QA pairs — GUIEnv-local SFT data source
Scope and source notes

Quantities are rounded publisher descriptions, not downloaded sample counts. Data-license declarations conflict across first-party sources; no permissive license is inferred.

GUIMid training data
web, android

mid-training instruction supervision, GUI post-training trajectories

text, images
Format
JSON, tar.gz image archives
train configurations for named mid-training domains
Data license
mit
Not recorded
Scope and source notes

Do not treat Hub size bands or the inconsistent introductory task count as a sample total. Some constituent-domain image packages remain forthcoming.

GUIOdyssey — current data release
android

cross-app trajectories, action grounding

screenshots, instructions, actions, bounding boxes, step context
Format
JSON annotations, PNG screenshots
random, task, device, app
Data license
cc-by-4.0
  • 8,334 episodes — recommended hflqf88888/GUIOdyssey release source
Scope and source notes

The repository gives conflicting episode totals (8,334 and 8,834). This profile uses 8,334 from the specifically recommended current dataset card. No independent archive recount was performed. Coordinates are normalized to 0–1000.

Jedi
desktop

icon grounding, component grounding, layout grounding, refusal

images, text, coordinates
Format
Not recorded
Not recorded
Data license
apache-2.0
Not recorded
Scope and source notes

Coordinates were resized for a specified Qwen2.5-VL image processor and must remain aligned with image resizing. AGUVIS++ material requires images from upstream AGUVIS and OS-Atlas releases; this repository is not a self-contained copy of every referenced image collection.

Mobile3M
android

mobile UI pretraining for MobileVLM

Not recorded
Format
7z app-graph archives, multipart 7z files
partial training release
Data license
Not recorded
Not recorded
Scope and source notes

Official README calls this a partial training release and says app data will be uploaded gradually. Its training-JSON and test-data links point to separate Hub repositories; those artifacts are not counted as files or splits of xwk123/Mobile3M. Public revision 3df26694 lists app-graph archives; their names do not establish a three-million-example downloadable inventory. Precise inner record/modalities schema is not inspected. The card YAML says Apache-2.0 while its prose and official README assign CC-BY-NC-SA-4.0 to data and Apache to code; the existing data-license value remains unknown with the conflict documented.

MobileViews
android

paired screenshot/view-hierarchy structure, recorded app states, actions and transitions

screenshots, view hierarchies, action traces, app metadata
Format
JPEG, JSON, XML, Parquet, CSV, ZIP packages, HTML/JavaScript trace visualization
Not recorded
Data license
mit
  • > 600,000 screenshot–view-hierarchy pairs — publisher-reported MobileViews-600K first release source
  • > 20,000 Android apps — publisher-reported MobileViews-600K first release source
Scope and source notes

Counts describe the card’s first-release claim, not an independently counted archive inventory. The card distinguishes globally image-hash-deduplicated screenshot/VH pairs from the November 2024 complete-app traces; trace state counts must not be added as new unique screens. JPEG/JSON and Parquet are alternative representations. Listed filename ranges are examples, not a complete count proof. No train/validation/test split is documented. Hub revision c734715e is ungated; MIT is its data declaration, without resolving third-party app content rights.

MONDAY annotations
android, ios

video-derived scene and action annotations

text, timestamps, bounding boxes, action labels
Format
Parquet
train, validation, test, test_unseen_os
Data license
Not recorded
  • 19,725 video annotation records — train split source
  • 495 video annotation records — validation split source
  • 100 video annotation records — test split source
  • 50 video annotation records — test_unseen_os split source
  • ≈ 333,000 detected scenes — publisher overview of MONDAY source
  • ≈ 313,000 identified actions — publisher overview of MONDAY source
Scope and source notes

Split counts are video-annotation rows; scene and action totals are rounded publisher reports and are not added to row counts. Source videos/images are not included in the Hub files.

MoTIF
android

interaction trajectories, task feasibility

screenshots, view hierarchies, language, interaction sequences, feasibility labels
Format
JSON metadata, screen images
Not recorded
Data license
Not recorded
Not recorded
Scope and source notes

The raw collection mixes action, language, exploration, and unusable/other traces. These groups have different annotation coverage; not every raw trace is a valid task demonstration.

MT-Mind2Web
web

multi-turn web instruction following, element/action prediction

dialogue text, HTML, element candidates, actions
Format
JSON, auxiliary PKL
train, test_task, test_website, test_subdomain
Data license
cc-by-4.0
  • 600 conversations — train source
  • 34 conversations — test-task source
  • 42 conversations — test-website source
  • 44 conversations — test-subdomain source
  • 2,896 dialogue turns — train source
  • 191 dialogue turns — test-task source
  • 218 dialogue turns — test-website source
  • 216 dialogue turns — test-subdomain source
Scope and source notes

Conversation, dialogue-turn and action-step units differ. The released file manifest is inspected; underlying examples were not downloaded.

MultiUI
web

UI understanding, text-rich visual tasks

webpage UI content, text, accessibility-derived structure
Format
Not recorded
training collection
Data license
Not recorded
  • ≈ 7,300,000 samples — reported MultiUI training collection source
Scope and source notes

The README provides a rounded sample count. It does not establish a unique-screenshot inventory or a normalized split breakdown. Synthetic examples and publicly sourced web content have provenance and quality limits; data terms must be checked separately from repository code.

OpenMobile-Data-v2
android, web

next-action supervision, verifiable task outcomes

screenshots, text, tool calls
Format
JSON, JSONL, PNG
sft/train, rl/train
Data license
Not recorded
  • 11,643 trajectories — SFT collection source
  • 118,582 decision steps — SFT collection source
  • 2,475 executable tasks — RL collection source
Scope and source notes

These are publisher-reported totals at three distinct grains, not values to sum. Earlier screenshots may be collapsed; each SFT example keeps at most three images. The card and repository disagree on the singular/plural RL filename, so consumers should inspect the actual file manifest.

OS-Atlas Data
cross-platform

element grounding

screenshots, referring expressions, bounding boxes
Format
JSON annotations, image archives
Not recorded
Data license
apache-2.0
  • > 270,000 screenshots — SeeClick-derived web subset source
  • > 3,000,000 UI elements — SeeClick-derived web subset source
  • ≥ 1,600,000 images — FineWeb-derived subset source
Scope and source notes

These are subset-specific counts, not a total for the full OS-Atlas release. Raw boxes use 0–1 coordinates; the documented training wrapper scales them to 0–1000.

OS-Genesis
cross-platform

reverse task synthesis, GUI action trajectories

screenshots, text, actions
Format
JSONL trajectories, JSON transition triples
Not recorded
Data license
Not recorded
Not recorded
Scope and source notes

The repository links distinct AndroidControl-oriented, AndroidWorld-oriented, and web training files plus raw pre-state/action/post-state triples. These are training artifacts, not a documented train/test split, and related representations are not disjoint corpus totals. No numerical inventory is asserted from release names or linked archives.

OS-Genesis mobile training data
android

mobile action trajectories

screenshots, text, actions
Format
JSONL, ZIP
AndroidControl training, AndroidWorld training
Data license
mit
Not recorded
Scope and source notes

AC and AW refer to distinct target training sets; no sample count is inferred from the two JSONL files or ZIP packaging.

PC-Agent-E training data
desktop, windows, linux

human demonstration refinement, generated action reasoning, trajectory augmentation

GUI screenshots, action trajectories, generated reasoning
Format
ZIP package
training
Data license
MIT
Not recorded
Scope and source notes

Public manifest exposes data.zip; the internal file schema and number of examples remain unverified. Supervision describes the publisher’s refinement/thought-completion/trajectory-boost pipeline, not an independently sampled data-quality audit.

Plan-and-Act training data
web

high-level plans, action execution

text, plans, actions
Format
JSON, JSONL
train (QwQ-32B files), validation (QwQ-32B files)
Data license
mit
Not recorded
Scope and source notes

The release contains planner and actor files for two web environments. No sample count is inferred from the package-file manifest. Card loading examples have repository/path inconsistencies.

Rico
android

UI structure and element properties, recorded human interactions, learned UI layout embeddings

screenshots, Android view hierarchies, gesture traces, transition animations, app/UI metadata
Format
PNG, JSON, CSV, NumPy NPY, GIF
Not recorded
Data license
Not recorded
  • > 66,000 unique UI screens — original Rico downloads described on the project page source
  • > 9,300 Android apps — original Rico collection described on the project page source
  • 10,811 human interaction traces — crowd-worker collection before automated exploration source
Scope and source notes

Project-page scope: screenshots paired with augmented view hierarchies, gesture coordinates, layout vectors and metadata. These observations are not action/task totals. The later semantic-annotation download is a related augmentation of screens, not an additional disjoint corpus. The retained original paper reports more than 72k screens from more than 9.7k apps while this project page says more than 66k screens and more than 9.3k apps; the difference is unresolved. Profile counts follow the project page and do not merge these populations. No train/validation/test partition or data license is established here; archives were not downloaded.

RoTS
cross-platform

recovery trajectory synthesis

GUI interaction trajectories
Format
Not recorded
Not recorded
Data license
Not recorded
  • ≈ 800,000 training samples — paper-described synthesis output; not a released file inventory source
Scope and source notes

The inspected README marks the dataset and collection pipelines as in preparation. This profile records an announced research asset, not a verified downloadable corpus; file formats, splits, and release-specific data terms remain unknown.

ScaleCUA Data
cross-platform

GUI grounding, GUI action trajectories

screenshots, text, actions
Format
JSONL annotations, JSON manifest, split image archives
Not recorded
Data license
Not recorded
  • 6 platform categories — Linux, macOS, Windows, Android, iOS, and Web source
Scope and source notes

The six categories include Web, so they are not six operating systems. Grounding and trajectory annotations follow different collection processes. No sample total or train/test division is inferred from archive-part counts or Hub size tags.

ScienceBoard evaluation trajectories
desktop, linux

evaluation rollout logs

screenshots, accessibility trees, text
Format
ZIP
Not recorded
Data license
Not recorded
Not recorded
Scope and source notes

Observation modes follow publisher archive labels rather than inspected record schemas. No count or training-use permission is inferred.

Screen2Words
android

screen summarization

text summaries, RICO screen references
Format
CSV
train, dev, test
Data license
Not recorded
  • 112,085 summaries — screen2words release source
  • 22,417 screens — RICO screens referenced by screen2words source
Scope and source notes

Multiple summaries describe one screen. The repository provides annotations and split files; use the referenced RICO assets for screenshots.

ScreenDrag
desktop

continuous GUI dragging

screen images, instructions, previous state, continuous actions
Format
Parquet, episode files
train, test
Data license
Not recorded
Not recorded
Scope and source notes

Raw and Parquet folders are alternative views of the same data. Each sample describes a dragging task over multiple timesteps; action vectors encode button state and coordinates.

ScreenQA
android

screen question answering, answer grounding

questions, answers, screen references, bounding boxes
Format
JSON
train, validation, test
Data license
Not recorded
  • 68,951 question-answer pairs — original ScreenQA train split source
  • 8,614 question-answer pairs — original ScreenQA validation split source
  • 8,419 question-answer pairs — original ScreenQA test split source
Scope and source notes

All questions for a given screenshot share one split. ScreenQA Short reuses the same questions/screens; ComplexQA is a separate extension. Do not add these variants as independent original examples.

ScreenRef
desktop, web, android, linux

instruction-to-click grounding, bounding boxes, absent-target abstention

screenshots, text, coordinates
Format
Parquet
train
Data license
other
  • 585,981 distinct screenshots — ScreenRef image inventory source
  • 633,369 annotation rows — full recipe source
  • 22,475 annotation rows — refusal subset of full recipe source
Scope and source notes

The publisher reports these inventories in the companion annotation card. The refusal subset is included in the full recipe. Screenshot access is gated; no image download or independent corpus recount was performed.

ScreenRef Annotations
desktop, web, android, linux

instruction-to-click grounding, bounding boxes, absent-target abstention

text, coordinates, image references
Format
JSONL, JSON task recipes, TSV manifests
full/train, point/train
Data license
other
  • 633,369 annotation rows — full recipe source
  • 610,894 annotation rows — point recipe source
Scope and source notes

The recipes reuse source images and are not additive datasets. This download contains no screenshots. Counts are publisher-reported; rows named for trajectories are independent decision examples, not full trajectories.

ScreenSpot-Pro data
desktop, windows, macos, linux

GUI grounding

high-resolution screenshots, instructions, bounding boxes
Format
JSON annotations, screen images
Not recorded
Data license
mit
  • 1,581 target annotations — sum of icon/text counts in the published card table (computed) source
Scope and source notes

Counts describe target annotations, not unique screenshots or expanded language/style variants. The evaluation code can reuse a target across configurations.

ShowUI Desktop
desktop

instruction-to-element grounding

screenshots, text, bounding boxes, points
Format
Hub table with an image column
train
Data license
Not recorded
  • 7,496 examples — train split declared in the dataset card source
Scope and source notes

The 8K release name is not an exact record count; the card declares 7,496 examples. Images and original annotations come from OmniAct and are augmented with generated descriptions. Examples are not asserted to be unique screenshots.

ShowUI-web
web

element grounding

screenshots, text, bounding boxes, points
Format
Parquet, JSON, TAR.GZ
train
Data license
Not recorded
  • 21,988 rows — train split source
Scope and source notes

Row count is the card dataset_info value; one row may contain multiple instructions. The card summarizes screenshots as approximately 22K. No data license is declared.

ShowUI-π training data
desktop

drag trajectories, click episodes

screenshots, instructions, actions
Format
Parquet, LeRobot metadata
Not recorded
Data license
Not recorded
Not recorded
Scope and source notes

No sample or episode count is inferred from the size tag or package manifest. Main-branch files were inspected; the card’s v3.0 usage example was not executed.

UGround V1 Data
cross-platform

GUI visual-grounding training for the UGround-V1 family

GUI screenshots, natural-language grounding descriptions
Format
Parquet shards
Not recorded
Data license
cc-by-nc-sa-4.0
Not recorded
Scope and source notes

Public API revision 33325877 lists Parquet assets but gated=auto; the pinned raw card returned HTTP 401 and no access was requested. Official README identifies this as V1 training data; the API excerpt also announces a Web-Hybrid bounding-box variant with coordinates normalized to [0,999]. That does not establish every shard schema or a release-wide point/bbox count. No train/test partition, example total, or unrestricted downloadability is claimed. Preserve the recorded CC-BY-NC-SA-4.0 data declaration separately from model/code terms.

UI-Genie reward data
android

trajectory rewards

text
Format
JSONL
Not recorded
Data license
mit
Not recorded
Scope and source notes

The public manifest contains reward_data.jsonl but no separately packaged image archive. The card declares MIT. The 517k identifier is not converted into a verified sample count, and complete image packaging is not inferred from the JSONL filename.

UI-Genie trajectory data
android

GUI action trajectories

screenshots, text, actions
Format
JSONL, PNG
Not recorded
Data license
mit
Not recorded
Scope and source notes

Public JSONL annotations and screenshots are present. MIT is declared in the dataset card. The release name, model-card links and annotation filename use different size labels; this review does not infer a reliable trajectory count from them.

UI-S1 released training examples
android

GUI actions

images, text, actions
Format
JSONL, Parquet
training example subset
Data license
apache-2.0
  • 1,000 training examples — public example subset source
Scope and source notes

The count is explicitly reported by the publisher, not inferred from the filename. Full training data remains outside this release.

UI-Vision
desktop

element grounding, layout grounding, action prediction

screenshots, bounding boxes, UI labels, action annotations
Format
JSON annotations, image files
Not recorded
Data license
mit
  • 83 software applications — paper-described benchmark coverage source
Scope and source notes

This is an offline evaluation dataset. Application coverage is not a sample count. The inspected file-layout documentation describes grounding annotations and images; it does not establish a common split or complete action-trajectory inventory.

UIBert AppSim and RefExp annotations
android

similar UI element retrieval, referring-expression component retrieval

text, bounding boxes, UI hierarchy metadata, Rico image identifiers
Format
TFRecord
AppSim train/dev/test, RefExp train/dev/test
Data license
CC-BY-4.0
Not recorded
Scope and source notes

Original UI images are retrieved separately by Rico IDs. No release-specific sample count is established.

UICrit
unspecified

design critique, region localization, quality rating

text, bounding boxes, quality ratings
Format
CSV
Not recorded
Data license
Not recorded
  • 1,000 mobile UI screens — current three-annotator release source
  • 11,344 design critiques — current three-annotator release source
Scope and source notes

Publisher-reported current release, separate from the smaller original-paper population. Screenshot pixels are obtained through referenced RICO IDs.

VideoCAD data
web

timestamped UI actions, target model images

video, UI action logs, target CAD images
Format
ZIP, MP4, JSON, PNG
Not recorded
Data license
CC0 1.0
  • > 41,000 video recordings — VideoCAD published collection source
Scope and source notes

The reported video total is distinct from the Dataverse package-file count. The exact-version paper identifies the recorded interface as browser-based Onshape; operating-system compatibility is not established.

Wave UI
unspecified

instruction-to-target boxes

images, text, bounding boxes, OCR metadata
Format
Parquet
train, validation, test
Data license
Wave UI Dataset License; per-image source terms retained
  • 63,530 rows — train split source
  • 7,944 rows — validation split source
  • 7,938 rows — test split source
Scope and source notes

Card-reported row counts are not unique-screen counts. The source field is important for the per-image license terms; the compilation does not relicense original images.

WebEvolver SFT data
web

agent-policy supervised fine-tuning, web-world-model supervised fine-tuning

Not recorded
Format
JSONL
Not recorded
Data license
MIT
Not recorded
Scope and source notes

Two purpose-specific files are released: webevolver_policy_sft.jsonl and webevolver_world_model_sft.jsonl. They are not assumed disjoint train/test splits, and no modality or example count is inferred from filenames alone.

WebPRM checklist-generation data
web

checklist generation, subgoal analysis

screenshots, text, action history
Format
Parquet
test
Data license
Not recorded
  • 3,630 rows — Hub split named test source
Scope and source notes

This is the checklist-generation release rather than the separate preference-pair collection. No unique-task count or data permission is inferred.

WebPRM Collection preference data
web

preferred and rejected continuations, task checklists

screenshots, text, action history
Format
Parquet
test
Data license
Not recorded
  • 9,460 rows — Hub split named test source
Scope and source notes

Preserves the publisher’s split label despite the collection’s training purpose. Rows are not individual preference pairs because rejected is a list. Data license is unknown.

WebSRC v1.0
web

extractive or yes/no answers, answer DOM-element references

questions and answers, HTML, screenshots, layout metadata
Format
CSV, HTML, JSON, ZIP packages
train, dev, test
Data license
CC-BY-4.0
  • 307,315 question–answer examples — WebSRC v1.0 train source
  • 4,549 web pages — WebSRC v1.0 train source
  • 52,826 question–answer examples — WebSRC v1.0 dev source
  • 913 web pages — WebSRC v1.0 dev source
  • 40,357 question–answer examples — WebSRC v1.0 test source
  • 985 web pages — WebSRC v1.0 test source
Scope and source notes

Each dataset.csv row is a QA example; web pages and QA examples are different units. Use the v1.0 split table rather than merging the older project headline into it. The card retains email-evaluation instructions, while the manifest now includes test answers; no submission was made. Payload archives were not downloaded.

WorkDemo-350
desktop

human workflow demonstrations, skill induction

screen video, screenshots, input events, task text
Format
MP4, PNG, JSON, JSONL, commented key logs
Not recorded
Data license
cc-by-4.0
  • 350 demonstrations — packaged tasks/videos source
  • 8,388 evidence images — final packaged images source
  • 11,951 action records — packaged action traces source
Scope and source notes

The OSWorld subset was selected post hoc using model outcomes; no train/test split is supplied. Coordinate calibration, task success, and complete anonymization are not established by package-format checks.

Use each resource page for source timestamps, content fingerprints, and separate code, data, and weight licenses.

Download these profiles as JSON · Complete catalog and SQLite · Compare benchmarks