UIBert AppSim and RefExp annotations

Two Rico-derived UI component retrieval datasets: AppSim pairs semantically similar elements across screens, while RefExp links referring expressions to target elements.

AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.

What is this resource?

Resource type

Datasets

Environment

android

Topics

grounding, screen-understanding, evaluation

Record publication date

Not recorded

Evidence retrieved

2026-10-17T12:30:54Z

Resource ID

github:google-research-datasets/uibert

What licenses are recorded?

Code, training data, weights, and documents can have different terms. A blank declaration means unknown, not unrestricted use.

Code

Not recorded

Data

CC-BY-4.0 (The README explicitly says the datasets are licensed under CC BY 4.0; original Rico materials keep their source terms.)

Document

Not recorded

Weights

Not recorded

License review notes

• Data: The README explicitly says the datasets are licensed under CC BY 4.0; original Rico materials keep their source terms. Source 1

Dataset profile

Supervision

similar UI element retrieval, referring-expression component retrieval

Modalities

text, bounding boxes, UI hierarchy metadata, Rico image identifiers

Formats

TFRecord

Splits

AppSim train/dev/test, RefExp train/dev/test

Scale and counting units

Original UI images are retrieved separately by Rico IDs. No release-specific sample count is established.

Compare source-reviewed profiles

Recorded specifications

availability

Public archived TFRecord annotation files for both downstream tasks.

repository revision

eceafbde7567959899bfb7f8d9e6fd71a52aaa12

Explore related topics

Scope and limitations

The archived repository retains TFRecord train/dev/test files for AppSim and RefExp. These are annotation and UI-structure records with Rico image identifiers, not a republished complete screenshot collection or a UIBert checkpoint. The README’s 72k figure describes the upstream Rico source, not the number of released AppSim/RefExp examples; no sample total is inferred. The publisher explicitly assigns CC-BY-4.0 to these datasets.

Related resources

• uses: Rico
• documented by: UIBert: Learning Generic Multimodal Representations for UI Understanding

Primary evidence and verification

Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.

1. editorial primary review

   Retrieved 2026-10-17T12:30:54Z. Supports: name, kind, summary, topics, scope, notes, relations, details.dataset_profile, licenses.data.

   Content fingerprint

   45d1ca0f5c727cf58b2671dc5579f0628f4d78e07b977a5d8b018295c6fe1f58
2. editorial primary review

   Retrieved 2026-10-17T12:30:54Z. Supports: identity.

   Content fingerprint

   24a7838d425bdae363a7d5872702996b22068c1f0e47be274fdfbc4b0e20144f
3. editorial primary review

   Retrieved 2026-10-17T12:32:05Z. Supports: release_status, details.repository_revision.

   Content fingerprint

   9a6fc19c6b407309943fe645f4addb3d032f153856976c4f8d7a8cfb6d2ffe6b
4. editorial primary review

   Retrieved 2026-10-17T12:36:55Z. Supports: environments, notes.

   Content fingerprint

   f752ebfb2598b7f848d343f428502b28e0f591f27849ab707f14bee398d4eb8d

Suggest a correction

Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.