AndroidWorld
Android environment with programmatic task evaluation for mobile agents.
AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.
What is this resource?
- Resource type
- Benchmarks
- Environment
- android
- Topics
- evaluation, mobile-navigation
- Record publication date
- Not recorded
- Evidence retrieved
- 2026-10-16T06:35:57Z
- Resource ID
- github:google-research/android_world
What licenses are recorded?
Code, training data, weights, and documents can have different terms. A blank declaration means unknown, not unrestricted use.
- Code
- Apache-2.0 (repository LICENSE header; not a weights/data license)
- Data
- Not recorded
- Document
- Not recorded
- Weights
- Not recorded
Evaluation protocol
- Focus
- mobile task completion
- Setting
- interactive
- Observations
- screenshots, accessibility information
- Actions / outputs
- Android device interactions
- Evaluation
- Programmatic task-specific initialization, system-state success checks, and teardown.
Scale and counting units
- 116 task definitions — parameterized AndroidWorld tasks source
- 20 applications — documented AndroidWorld app set source
Random parameters produce many instances from the same task definitions. Preserve seeds and parameterization; 116 is not a count of all possible task instances.
Compare source-reviewed profiles
Recorded specifications
- evaluation type
- programmatic state checks
- leaderboard url
- https://docs.google.com/spreadsheets/d/1cchzP9dlTZ3WXQTfYNhh3avxoLipqHN75v1Tb86uhHo/edit?gid=0#gid=0
- metrics
- ["task success"]
- task count
- 116
- task unit
- parameterized task definitions
Explore related topics
Related resources
Primary evidence and verification
Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.
- editorial primary review
Retrieved 2026-10-16T06:35:57Z. Supports: name, kind, summary, environments, topics, scope, relations, details.task_count, details.task_unit, details.metrics, details.evaluation_type, details.benchmark_protocol, details.leaderboard_url.
Content fingerprint
93201de5e21f2b12283a75b1e2c357781b2e6cc27eab20cc7dd7aa0f5919d839 - editorial primary review
Retrieved 2026-10-16T06:31:28Z. Supports: details.benchmark_protocol.
Content fingerprint
be244bfae7f89ef9449b69d85aac44295eb7b5f7e5e1bbedd76df312696676a7 - license header
Retrieved 2026-10-16T06:41:57Z. Supports: licenses.code.
Content fingerprint
b09fcaf4fbc265223c2479c410beef2b98c5e687c78ecedf3452aa12ffc465f1
Suggest a correction
Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.