Research papers

SUGILITE: Creating Multimodal Smartphone Automation by Demonstration

Introduces SUGILITE, which combines spoken instructions, demonstrated Android actions, and UI hierarchies to generate reusable automation scripts. Its interface includes context checking and repairs for unfamiliar situations and changing app interfaces.

AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.

Original source ↗Read as MarkdownRecord JSON

What is this resource?

Resource type
Research papers
Environment
android
Topics
mobile-navigation, recording, human-in-the-loop, cross-app
Record publication date
2017
Evidence retrieved
2026-10-17T09:54:39Z
Resource ID
url:392a602c660ffa91be46

Authors

Toby Jia-Jun Li, Amos Azaria, Brad A. Myers

Cite this paper

Download BibTeX · Download CSL JSON

Citations preserve the selected source edition, its authors and recorded date precision. Unrecorded venues and identifiers are omitted.

Publication record

Title
SUGILITE: Creating Multimodal Smartphone Automation by Demonstration
Authors
Toby Jia-Jun Li, Amos Azaria, Brad A. Myers
Publication date (recorded precision)
2017
Venue
Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
Pages
6038-6049
DOI
10.1145/3025453.3025483

Publication source ↗ · Publisher or author PDF ↗

Publication BibTeX · Publication CSL JSON

Date source: Supplied year precision: 2017. Publications: SUGILITE, CHI 2017 Only publication year is asserted; event dates are kept separate.

Source notes: Related to later APPINITE and PUMICE work but distinguished here by its 2017 three-author publication and base demonstration-automation contribution. Publication month/day are not independently identified by the retained sources.

Explore related topics

Mobile navigationRecordingHuman in the loopCross-app

Scope and limitations

The annotation was reviewed against retained primary publication sources. Experiments have not been independently reproduced. Related to later APPINITE and PUMICE work but distinguished here by its 2017 three-author publication and base demonstration-automation contribution.

Primary evidence and verification

Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.

  1. editorial primary review

    Retrieved 2026-10-17T09:53:22Z. Supports: details.publication.date_basis, details.publication.date_parts, details.publication.notes, details.publication.type, details.publication.venue.

    Content fingerprint32ee05ff1a91ed4a22d4bc156a462872aa4e28f5c79abfbce5dbf3655f412033
  2. editorial primary review

    Retrieved 2026-10-17T09:54:39Z. Supports: details.publication.authors, details.publication.doi, details.publication.identity_basis, details.publication.notes, details.publication.pages, details.publication.pdf_url, details.publication.title, details.publication.url.

    Content fingerprintcc23c19284f0a558c4b99b8b051abca8ed61e274e9e1f1fed1ae91487f4368ad
  3. editorial primary review

    Retrieved 2026-10-17T09:54:39Z. Supports: details.publication.authors, details.publication.doi, details.publication.identity_basis, details.publication.notes, details.publication.pages, details.publication.pdf_url, details.publication.title, details.publication.url, environments, name, scope, summary, topics.

    Content fingerprintcc23c19284f0a558c4b99b8b051abca8ed61e274e9e1f1fed1ae91487f4368ad
  4. editorial primary review

    Retrieved 2026-10-17T09:53:22Z. Supports: details.publication.date_basis, details.publication.date_parts, details.publication.notes, details.publication.type, details.publication.venue, kind.

    Content fingerprint32ee05ff1a91ed4a22d4bc156a462872aa4e28f5c79abfbce5dbf3655f412033

Suggest a correction

Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.