iOSWorld
Native iPhone-simulator benchmark with shared user data, application workflows, agent runners, and rubric-based scoring.
AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.
What is this resource?
- Resource type
- Benchmarks
- Environment
- ios
- Topics
- evaluation, cross-app, memory
- Record publication date
- Not recorded
- Evidence retrieved
- 2026-10-16T10:42:12Z
- Resource ID
- github:ljang0/iosworld
What licenses are recorded?
Code, training data, weights, and documents can have different terms. A blank declaration means unknown, not unrestricted use.
- Code
- Apache-2.0 (repository LICENSE header; not a weights/data license)
- Data
- Not recorded
- Document
- Not recorded
- Weights
- Not recorded
Evaluation protocol
- Focus
- personalized phone tasks, cross-app workflows
- Setting
- interactive
- Observations
- screenshots, accessibility XML (optional)
- Actions / outputs
- touch actions, MCP tools (optional)
- Evaluation
- Rubric satisfaction per task; full-task pass requires every criterion to be satisfied.
Scale and counting units
Vision-only, vision-plus-XML, and MCP modes expose different information and tools. The documented default evaluator is model-based; compare the same mode and judge.
Compare source-reviewed profiles
Recorded specifications
- evaluation type
- rubric-based
- metrics
- ["mean rubric score", "full-task pass rate"]
- task count
- 133
Explore related topics
Primary evidence and verification
Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.
- editorial primary review
Retrieved 2026-10-16T10:42:12Z. Supports: name, kind, summary, environments, topics, scope, relations, details.task_count, details.metrics, details.evaluation_type, details.benchmark_protocol.
Content fingerprint
706f9d770b65a1238e56f74f7dd5089c7756cc88e0ac09d80c7b2b3085a09b27 - license header
Retrieved 2026-10-16T10:48:41Z. Supports: licenses.code.
Content fingerprint
fa9fe1e31ed8da21d0b51621d3a3669ced4f0e42353aaf4bd8be1615d200eaac
Suggest a correction
Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.