Mobile-Eval-E task definitions
Task definitions for Mobile-Agent-E’s long-horizon, multi-app Android evaluation, packaged as a 25-record test split with rubrics and human-reference operation strings.
AI-assisted editorial review against a primary source. This is a catalog annotation, not an independent reproduction or endorsement.
What is this resource?
- Resource type
- Benchmarks
- Environment
- android
- Topics
- evaluation, long-horizon, cross-app
- Record publication date
- Not recorded
- Evidence retrieved
- 2026-10-18T04:27:15Z
- Resource ID
- url:342b081c3668a8bbe155
What licenses are recorded?
Code, training data, weights, and documents can have different terms. A blank declaration means unknown, not unrestricted use.
- Code
- Not recorded
- Data
- Not recorded
- Document
- Not recorded
- Weights
- Not recorded
License review notes
- Data: No data-license declaration is present in the inspected task card; companion code MIT does not establish a dataset grant. Source 1
Evaluation protocol
- Focus
- long-horizon multi-app Android task execution
- Setting
- interactive
- Observations
- task instructions, app/scenario metadata
- Actions / outputs
- Not recorded
- Evaluation
- The published task schema contains rubrics and human_reference_operations. No automated scoring protocol or single numeric agent metric is established by the inspected card; execution uses separately configured Android tooling.
Scale and counting units
- 25 task-definition records — Hub test split at revision b8eca829 source
Features are task_id, instruction, type, apps, scenario, rubrics and human-reference operation strings. A task record is not an action count or recorded screenshot trajectory. Public Parquet inventory was checked but no sample rows were downloaded; companion README limits the tested agent platform to Android.
Compare source-reviewed profiles
Recorded specifications
- disabled
- false
- download url
- https://huggingface.co/datasets/mikewang/mobile_eval_e/tree/b8eca82988ed8d4f9dec01eaa9d51abf4b35aa83
- gated
- false
- hub id
- mikewang/mobile_eval_e
- hub revision
- b8eca82988ed8d4f9dec01eaa9d51abf4b35aa83
- repository url
- https://github.com/X-PLUG/MobileAgent/tree/main/Mobile-Agent-E
Explore related topics
Scope and limitations
The public Hub manifest contains one test Parquet file. This resource is the benchmark’s task-definition package, not a bundled phone environment or agent. Card metadata supplies rubrics/reference-operation fields but no data-license declaration or verified automated scorer; the code repository’s MIT license is not transferred to these records.
Related resources
Primary evidence and verification
Source retrieval is separate from experiment reproduction. Use the original publication or publisher page when citing claims about the resource.
- editorial primary review
Retrieved 2026-10-18T04:27:15Z. Supports: name, kind, environments, scope, notes, relations, details.benchmark_protocol.
Content fingerprint
f8515fbce73ea0ef3d1d558d4567bb949244e6384e61c956ba3ddbc27294f0ae - editorial primary review
Retrieved 2026-10-18T04:33:29Z. Supports: identity, release_status, details.hub_id, details.hub_revision, details.gated, details.disabled, details.download_url, details.benchmark_protocol.
Content fingerprint
f9b10eada9e0a64e26f1a7d477768f218b807103199855d893b3ab07feddc755 - editorial primary review
Retrieved 2026-10-18T04:35:15Z. Supports: summary, details.benchmark_protocol, licenses.data.
Content fingerprint
9fdf43753fbfac9868d8bec57fa5601db3e03ed5c30fb981f9da88f6b75ffcc5 - editorial primary review
Retrieved 2026-10-16T06:31:38Z. Supports: summary, topics, details.benchmark_protocol.
Content fingerprint
e96b86015c763c780e0430a8d0867b96cae947f50e888b3441c85abcaa42de78
Suggest a correction
Open a source-backed correction. Include this record ID and the original source. Read our editorial policy and coverage boundaries.