AwesomeCUAGitHub ↗
Research papers

Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements

Introduces crowdsourced descriptions of mobile UI elements and studies multimodal models that generate useful widget captions.

AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.

Original source ↗Read as MarkdownRecord JSON

What is this resource?

Resource type
Research papers
Environment
unspecified
Topics
screen-understanding, grounding
Record publication date
2020-10-08
Evidence retrieved
2026-10-16T06:42:42Z
Resource ID
arxiv:2010.04295

Recorded paper version

arXiv v1

Version updated: 2020-10-08T22:56:03Z.

This identifies the retained arXiv metadata snapshot; newly observed changes require separate review.

Abstract fingerprint68af0a0a4b605d0c968e8913232fde16e3eadf6361099e8fc3d015dcdb26302b

Authors

Yang Li, Gang Li, Luheng He, Jingjie Zheng, Hong Li, Zhiwei Guan

Cite this paper

Download BibTeX · Download CSL JSON

Citations preserve the selected source edition, its authors and recorded date precision. Unrecorded venues and identifiers are omitted.

Publication record

Title
Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements
Authors
Yang Li, Gang Li, Luheng He, Jingjie Zheng, Hong Li, Zhiwei Guan
Publication date (recorded precision)
2020-11
Venue
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
Publisher
Association for Computational Linguistics
Pages
5495-5510
DOI
10.18653/v1/2020.emnlp-main.443

Publication source ↗ · Publisher or author PDF ↗

Publication BibTeX · Publication CSL JSON

This publication is a separately recorded edition of the same work. Its citation uses its own title, authors and date; the retained arXiv citation above is unchanged.

Date source: Explicit publisher metadata: 2020/11; precision=month.

Source notes: The retained arXiv abstract reports 162,859 phrases; the ACL abstract reports 162,860. This publication proposal does not overwrite the arXiv annotation or assert a unified dataset count. Publisher-hosted proceedings record; distinct from the retained arXiv preprint snapshot.

Explore related topics

Screen understandingGUI grounding

Scope and limitations

The annotation and scope were reviewed against the primary paper abstract. Experimental results and released artifacts have not been independently reproduced.

Primary evidence and verification

Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.

  1. arxiv api

    Retrieved 2026-10-16T06:42:42Z. Supports: name, authors, published_at, updated_at, identifiers.arxiv, details.arxiv_snapshot.

    Content fingerprintd1c1bc3fee56d124427abd2aabbcf876418633a8adf7a03f4ef0317cba6a42ae
  2. editorial primary review

    Retrieved 2026-10-17T09:53:48+00:00. Supports: details.publication.authors, details.publication.date_basis, details.publication.date_parts, details.publication.doi, details.publication.identity_basis, details.publication.notes, details.publication.pages, details.publication.pdf_url, details.publication.publisher, details.publication.title, details.publication.type, details.publication.url, details.publication.venue.

    Content fingerprint750e60b4d28e5b97a46595ea2280b520bf9edcc445b9931bad225e0028935c5e
  3. editorial primary review

    Retrieved 2026-10-16T06:42:42Z. Supports: name, kind, summary, environments, topics, scope, relations.

    Content fingerprintd1c1bc3fee56d124427abd2aabbcf876418633a8adf7a03f4ef0317cba6a42ae

Suggest a correction

Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.