Research papers

Harnessing Webpage UIs for Text-Rich Visual Understanding

Builds MultiUI by generating instructions from webpage accessibility trees and pairing them with screenshots for multimodal training. Evaluation examines web-interface understanding, including VisualWebBench and Mind2Web, and transfer to other text-rich visual tasks.

AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.

Original source ↗Read as Markdown Record JSON

What is this resource?

Resource type: Research papers
Environment: web
Topics: data-generation, screen-understanding, grounding
Record publication date: 2024-10-17
Evidence retrieved: 2026-10-16T06:31:35Z
Resource ID: arxiv:2410.13824

Recorded paper version

arXiv v3

Version updated: 2024-11-06T08:29:22Z.

This identifies the retained arXiv metadata snapshot; newly observed changes require separate review.

Abstract fingerprint

2a3bcd26dff4f1d21a8a2772929c0c97cd1cc180a7606b0744e630dabae94609

Authors

Junpeng Liu, Tianyue Ou, Yifan Song, Yuxiao Qu, Wai Lam, Chenyan Xiong, Wenhu Chen, Graham Neubig, Xiang Yue

Cite this paper

Download BibTeX · Download CSL JSON

Citations preserve the selected source edition, its authors and recorded date precision. Unrecorded venues and identifiers are omitted.

Publication record

Title: Harnessing Webpage UIs for Text-Rich Visual Understanding
Authors: Junpeng Liu, Tianyue Ou, Yifan Song, Yuxiao Qu, Wai Lam, Chenyan Xiong, Wenhu Chen, Graham Neubig, Xiang Yue
Publication date (recorded precision): 2025-05-01
Venue: International Conference on Learning Representations
Volume: 2025
Pages: 17971-18005

Publication source ↗ · Publisher or author PDF ↗

Publication BibTeX · Publication CSL JSON

This publication is a separately recorded edition of the same work. Its citation uses its own title, authors and date; the retained arXiv citation above is unchanged.

Date source: Explicit publisher citation_publication_date: 2025-05-01. Preserve supplied precision; do not substitute conference event dates.

Source notes: Publisher proceedings edition; retained separately from the arXiv snapshot.

Explore related topics

Data generation Screen understanding GUI grounding

Scope and limitations

Reviewed against the retained original arXiv abstract. Experimental results and artifact availability have not been independently reproduced.

Connected assets

These links come from reviewed resource records. A documentation link does not imply a training-data or evaluation dependency.

Documented resource: UIX-Qwen2 · Models and checkpoints · relationship evidence

Primary evidence and verification

Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.

arxiv api
Retrieved 2026-10-16T06:31:35Z. Supports: name, authors, published_at, updated_at, identifiers.arxiv, details.arxiv_snapshot.
Content fingerprint
b3e67984f59a1b05ccd946eb54e2d37b0bb78ab0ca796fbb6d544793dafea3e0
editorial primary review
Retrieved 2026-10-18T04:10:02Z. Supports: details.publication.authors, details.publication.date_basis, details.publication.date_parts, details.publication.identity_basis, details.publication.notes, details.publication.pages, details.publication.pdf_url, details.publication.title, details.publication.type, details.publication.url, details.publication.venue, details.publication.volume.
Content fingerprint
899100e1d0cad8d949c9075f62ab3506995587b01aab3981ac4e26eaf6d88339
editorial primary review
Retrieved 2026-10-16T06:31:35Z. Supports: name, kind, summary, environments, topics, scope, notes.
Content fingerprint
b3e67984f59a1b05ccd946eb54e2d37b0bb78ab0ca796fbb6d544793dafea3e0

Suggest a correction

Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.