LlamaTouch
Mobile UI task evaluation using application state information.
AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.
What is this resource?
- Resource type
- Benchmarks
- Environment
- android
- Topics
- evaluation
- Record publication date
- Not recorded
- Evidence retrieved
- 2026-10-16T06:35:58Z
- Resource ID
- github:llamatouch/llamatouch
What licenses are recorded?
Code, training data, weights, and documents can have different terms. A blank declaration means unknown, not unrestricted use.
- Code
- Not recorded
- Data
- Not recorded
- Document
- Not recorded
- Weights
- Not recorded
Evaluation protocol
- Focus
- mobile task completion, essential-state evaluation
- Setting
- interactive
- Observations
- screenshots, view hierarchies, Android activity names
- Actions / outputs
- device actions through AgentEnv
- Evaluation
- Checks whether the recorded execution visits all annotated essential states rather than requiring an identical action sequence.
Scale and counting units
- 495 tasks — complete task collection source
- 102 tasks — AITW-derived subset source
- 393 tasks — self-constructed subset source
- 46 Android applications — self-constructed subset source
Application coverage refers to the self-constructed subset. Task execution and essential-state annotation are separate components; counts are publisher-reported, not a fresh task-file recount.
Compare source-reviewed profiles
Explore related topics
Related resources
Primary evidence and verification
Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.
- editorial primary review
Retrieved 2026-10-16T06:35:58Z. Supports: name, kind, summary, environments, topics, scope, relations, details.
Content fingerprint
4c4fe0fa92961f7286b6553b13117b2942e8482a48b7120a79e57dce2f8d42b9 - editorial primary review
Retrieved 2026-10-16T06:35:58Z. Supports: details.benchmark_protocol.
Content fingerprint
4c4fe0fa92961f7286b6553b13117b2942e8482a48b7120a79e57dce2f8d42b9
Suggest a correction
Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.