Multimodal Web Navigation with Instruction-Finetuned Foundation Models
Trains WebGUM offline from demonstrations by jointly tuning an instruction-following language model and a vision encoder over webpage screenshots and HTML. The agent predicts browser actions and is evaluated on MiniWoB, WebShop, and Mind2Web.
AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.
What is this resource?
- Resource type
- Research papers
- Environment
- web
- Topics
- web-navigation, imitation-learning, action-prediction
- Record publication date
- 2023-05-19
- Evidence retrieved
- 2026-10-16T06:31:20Z
- Resource ID
- arxiv:2305.11854
Recorded paper version
Version updated: 2024-02-25T16:21:00Z.
This identifies the retained arXiv metadata snapshot; newly observed changes require separate review.
Abstract fingerprint
ac0ea5a462890317ea29ade32c879d016181afbe5962e2d28cc175e251df41e6Authors
Hiroki Furuta, Kuang-Huei Lee, Ofir Nachum, Yutaka Matsuo, Aleksandra Faust, Shixiang Shane Gu, Izzeddin Gur
Cite this paper
Download BibTeX · Download CSL JSON
Citations preserve the selected source edition, its authors and recorded date precision. Unrecorded venues and identifiers are omitted.
Publication record
- Title
- Multimodal Web Navigation with Instruction-Finetuned Foundation Models
- Authors
- Hiroki Furuta, Kuang-Huei Lee, Ofir Nachum, Yutaka Matsuo, Aleksandra Faust, Shixiang Shane Gu, Izzeddin Gur
- Publication date (recorded precision)
- 2024-05-31
- Venue
- International Conference on Learning Representations
- Volume
- 2024
- Pages
- 29528-29558
Publication source ↗ · Publisher or author PDF ↗
Publication BibTeX · Publication CSL JSON
This publication is a separately recorded edition of the same work. Its citation uses its own title, authors and date; the retained arXiv citation above is unchanged.
Date source: Explicit publisher metadata: 2024-05-31; precision=day.
Source notes: The ICLR landing shortens Shixiang Shane Gu to Shixiang Gu. Publication authors use the full PDF title-page form. Volume 2024 and pages 29528–29558 are explicit publisher citation metadata, not values inferred from the event year or PDF page count. Publisher-hosted proceedings record; distinct from the retained arXiv preprint snapshot.
Explore related topics
Scope and limitations
Reviewed against the retained original arXiv abstract. Experimental results and artifact availability have not been independently reproduced.
Primary evidence and verification
Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.
- arxiv api
Retrieved 2026-10-16T06:31:20Z. Supports: name, authors, published_at, updated_at, identifiers.arxiv, details.arxiv_snapshot.
Content fingerprint
cbe8bfcbce4170a94a6cf42de01fbe0a448e7b1d29fa75a0de877105a98ec08e - editorial primary review
Retrieved 2026-10-17T09:53:48+00:00. Supports: details.publication.date_basis, details.publication.date_parts, details.publication.identity_basis, details.publication.notes, details.publication.pages, details.publication.pdf_url, details.publication.title, details.publication.type, details.publication.url, details.publication.venue, details.publication.volume.
Content fingerprint
6669190c7fc2a37f9cd68d0c49431b8f17b626c16bb3ef4093fc83a6ac62acd3 - editorial primary review
Retrieved 2026-10-17T09:59:46+00:00. Supports: details.publication.authors, details.publication.identity_basis, details.publication.notes.
Content fingerprint
da26ea085252edfda4c084058aa81ea023f885ff97c67f2ffae0698bab6f568b - editorial primary review
Retrieved 2026-10-16T06:31:20Z. Supports: name, kind, summary, environments, topics, scope, notes.
Content fingerprint
cbe8bfcbce4170a94a6cf42de01fbe0a448e7b1d29fa75a0de877105a98ec08e
Suggest a correction
Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.