GELab Zero
Open mobile GUI agent stack pairing a 4B model that runs on consumer hardware with local multi-device infrastructure, an MCP server, and AndroidDaily benchmark tasks.
已审阅并标注「手机操作」的研究与资产。
条目依据已审阅标签归类,同一主题不表示资源之间存在依赖关系。日期保留来源精度,注释保留原语言。
Open mobile GUI agent stack pairing a 4B model that runs on consumer hardware with local multi-device infrastructure, an MCP server, and AndroidDaily benchmark tasks.
Preview GELab-Zero phone-use agent checkpoint fine-tuned from Qwen3-VL-4B-Instruct, with about 4.4B BF16 parameters, tagged for Android in English and Chinese, under Apache-2.0.
Microsoft foundation model for multimodal agents, pretrained with Set-of-Mark and Trace-of-Mark objectives on UI, robotics and video data and fine-tunable for web and mobile UI navigation.
A released MAI-UI checkpoint combining mobile GUI actions, agent-user interaction and tool-use-oriented navigation.
A GLM-4.1V-based mobile action checkpoint released by the MobileRL project for Android interaction.
Mobile-agent checkpoint based on Qwen3.6-27B for GUI and app-native tool interaction.
Mobile-agent checkpoint trained on OpenMobile-Data-v2 for screenshot actions and app-native tool calls.
The AndroidControl-oriented Qwen2-VL checkpoint trained with mobile trajectories generated through OS-Genesis reverse task synthesis.
A Qwen2.5-VL mobile action model trained using existing and reward-guided synthetic trajectories from the UI-Genie framework.
A mobile GUI checkpoint trained with semi-online reinforcement learning that uses offline trajectories to improve multi-turn action prediction.
Multimodal agent that operates Android apps through taps and swipes without back-end access, building a reusable knowledge base from autonomous exploration or from watching human demonstrations.
Proactive Android agent built on AppAgent that uses GPT-4o to decide whether YouTube or Amazon content would help, operates those apps over ADB, and merges what it finds into its answer.
Screenshot-based mobile agent implementation with training and inference code for chain-of-action prediction.
LLM-powered Android task automation built on DroidBot, released with DroidTask, a dataset of per-app screenshots, view hierarchies, exploration records and ground-truth task files.
An Android automation implementation that builds app documentation from exploration traces and evaluates language-model-generated execution code in emulator workflows.
Mobile automation framework that uses reusable basis subtasks to constrain and refine planning between user goals and executable actions.
Research scripts that generate screen descriptions, action reasoning and expected outcomes, then predict Android GUI actions using the resulting Chain-of-Action-Thought context.
Research implementation combining screen and layout perception with conditional action prediction for smartphone automation.
Released inference and evaluation code for demonstration-conditioned mobile GUI agents on LearnGUI-Offline. The repository describes a multi-agent adaptation method and links the LearnGUI demonstrations.
Published MAI-UI grounding and navigation-agent implementations with inference demos and evaluation scripts.
Training and evaluation pipeline for conversational mobile GUI agents, with action prediction, response generation, and dataset processing.
An Android agent that combines global task planning and memory with a local action executor, using reflection to revise mobile interaction steps.
An MCP server exposing mobile accessibility snapshots, screenshots and device interactions across real devices, simulators and emulators.
Android GUI agent that operates real phones through ADB with hierarchical reflection and a multi-agent framework, run from a web interface or Python and evaluated on AndroidWorld and AndroidLab.
Android automation component with hierarchical planning, reflection and persistent tips/shortcuts learned across task sequences.
Mobile-control research implementation combining operating-procedure context with human interaction for personalized task execution.
Android GUI-agent adaptation framework combining app exploration, generated curricula and rollout feedback with hint-conditioned step-level GRPO; the documented public training path targets Qwen3-VL-8B.
An Android client and Python-server agent that learns reusable app subtasks through exploration, selection, derivation and memory recall.
A framework that combines screenshots and accessibility state with agent tools for mobile-device tasks through command-line and Python interfaces.
An Android accessibility service that exposes UI-element inspection, device-control interfaces and screen feedback to mobile automation agents.
iOS agent engine organized around an observe, decide, verify and act loop, using WebDriverAgent screen state and phone actions such as taps, typing, swipes and app switches.
Evaluation adapters and training guidance for OpenMobile-2 across Android emulators and browser-rendered mobile simulation.
Android GUI-agent research implementation that uses confidence-guided interaction to choose between autonomous actions and human assistance.
Memory-routing implementation that chooses text or image demonstrations for a frozen GUI actor, with offline evaluation and Android transfer experiments.
Training code that learns a value environment model from offline Android interaction data and uses its frozen value estimates to guide GUI policy optimization.
Research code for proactive human–GUI-agent verification, including offline interaction-loop and dual-agent evaluation scripts plus LLaMA-Factory fine-tuning configurations.
Runtime verification framework for Android GUI agents that checks proposed actions against logical rules derived from user instructions and developer-defined app states.
An Android automation implementation that translates screenshot-based UI understanding into language descriptions for step-by-step LLM planning and action execution.
Android phone assistant combining model-driven tool use with accessibility-tree reading, screenshots, and tap, swipe and text-entry primitives. Its documented interaction flow presents operation plans for user confirmation.
第 241–282 条,共 282 条资源。
通过主题导出清单获取完整记录和证据。克隆目录后,可将主题记录直接交给标准 RAG 与引用导出工具。