# APPINITE: A Multi-Modal Interface for Specifying Data Descriptions in Programming by Demonstration Using Natural Language Instructions

Introduces APPINITE, a conversational interface for specifying the intended targets of demonstrated Android actions. It constructs semantic UI representations and uses an on-screen overlay to preview and refine executable data descriptions.

- Catalog URL: https://awesomecua.github.io/resources/url-ba2c664c1b3c6f1b172f/
- Original source: https://ieeexplore.ieee.org/document/8506506
- Kind: paper
- Review: curated
- Scope: core
- Environments: android
- Topics: grounding, human-in-the-loop, mobile-navigation
- Evidence checked: 2026-10-17T09:54:46Z
- ID: url:ba2c664c1b3c6f1b172f

## Limitations

The annotation was reviewed against retained primary publication sources. Experiments have not been independently reproduced. The base SUGILITE framework and later PUMICE work are distinct publications; this paper focuses on resolving data-description ambiguity in demonstrations.

- Record JSON: https://awesomecua.github.io/resources/url-ba2c664c1b3c6f1b172f/record.json

## Authors

Toby Jia-Jun Li, Igor Labutov, Xiaohan Nancy Li, Xiaoyi Zhang, Wenze Shi, Wanling Ding, Tom M. Mitchell, Brad A. Myers

## Citation exports

- BibTeX: https://awesomecua.github.io/resources/url-ba2c664c1b3c6f1b172f/citation.bib
- CSL JSON: https://awesomecua.github.io/resources/url-ba2c664c1b3c6f1b172f/citation.csl.json

## Publication record

- Title: APPINITE: A Multi-Modal Interface for Specifying Data Descriptions in Programming by Demonstration Using Natural Language Instructions
- Authors: Toby Jia-Jun Li, Igor Labutov, Xiaohan Nancy Li, Xiaoyi Zhang, Wenze Shi, Wanling Ding, Tom M. Mitchell, Brad A. Myers
- Publication date (recorded precision): 2018
- Publication source: https://ieeexplore.ieee.org/document/8506506
- Publication BibTeX: https://awesomecua.github.io/resources/url-ba2c664c1b3c6f1b172f/publication-citation.bib
- Publication CSL JSON: https://awesomecua.github.io/resources/url-ba2c664c1b3c6f1b172f/publication-citation.csl.json
- venue: Proceedings of the 2018 IEEE Symposium on Visual Languages and Human-Centric Computing
- date basis: Supplied year precision: 2018. APPINITE publication citation: VL/HCC 2018
- identity basis: No same-work record located in the full active catalog. Similarity screening was not used as automatic identity approval. The raw archive and exclusions are additionally checked during normalization.
- notes: The base SUGILITE framework and later PUMICE work are distinct publications; this paper focuses on resolving data-description ambiguity in demonstrations. Author-hosted manuscript and institutional publication lists supply the retained evidence. DOI, final page range, and exact publication day remain unknown.
- Publication evidence: https://toby.li/files/TobyLi-VLHCC18-APPINITE.pdf, https://www.cs.cmu.edu/~NatProg/sugilite.html, https://toby.li/publications/

## License declarations

- code: not recorded
- data: not recorded
- document: not recorded
- weights: not recorded

## Primary evidence

- https://toby.li/files/TobyLi-VLHCC18-APPINITE.pdf (retrieved 2026-10-17T09:54:46Z; SHA-256 6e05fd08b187adba32148e0835ef6b9e20cd6a3ba5e0de6e2778eb18c02788ee)
- https://www.cs.cmu.edu/~NatProg/sugilite.html (retrieved 2026-10-17T09:53:22Z; SHA-256 32ee05ff1a91ed4a22d4bc156a462872aa4e28f5c79abfbce5dbf3655f412033)
- https://toby.li/publications/ (retrieved 2026-10-17T09:55:20Z; SHA-256 adfcec73830b612b181d4846ace3fbaab1768e906715c1d90fe657e23fe4d985)
- https://toby.li/files/TobyLi-VLHCC18-APPINITE.pdf (retrieved 2026-10-17T09:54:46Z; SHA-256 6e05fd08b187adba32148e0835ef6b9e20cd6a3ba5e0de6e2778eb18c02788ee)
- https://www.cs.cmu.edu/~NatProg/sugilite.html (retrieved 2026-10-17T09:53:22Z; SHA-256 32ee05ff1a91ed4a22d4bc156a462872aa4e28f5c79abfbce5dbf3655f412033)
- https://toby.li/publications/ (retrieved 2026-10-17T09:55:20Z; SHA-256 adfcec73830b612b181d4846ace3fbaab1768e906715c1d90fe657e23fe4d985)