Planning
Source-reviewed research and assets tagged with Planning.
Membership follows reviewed tags; it does not establish a dependency between neighboring records. Dates preserve source precision. Annotations retain their original language.
OpenCUA 32B
A Qwen2.5-VL-based computer-use checkpoint that combines screenshot history with planning and grounded executable actions.
OpenCUA 72B
A Qwen2.5-VL-based computer-use checkpoint that combines screenshot history and reflective reasoning to predict executable desktop actions.
Plan-and-Act Planner 70B
The planner component of Plan-and-Act, generating structured high-level plans that an executor turns into web actions.
ScaleCUA 7B
A Qwen2.5-VL-based computer-use checkpoint with direct grounding and agent action modes across desktop, mobile and web interfaces.
UI-TARS
Native GUI agent models; UI-TARS-1.5 adds reinforcement-learned reasoning before acting and an open 7B checkpoint, and UI-TARS-2 extends to games, code and tool use.
UI-TARS 1.5 7B
UI-TARS 1.5 GUI-agent checkpoint in the Qwen2.5-VL architecture with about 8.3B parameters stored in FP32, released under Apache-2.0 for English image-text-to-text use in Transformers.
UI-Venus
GUI agent model family; UI-Venus-2, at 9B and 27B, acts on mobile, web and desktop in one end-to-end agent, trained with keypoint-based multi-judge task verification.
UI-Venus 2 9B
UI-Venus 2 GUI-agent checkpoint fine-tuned from Qwen3.5-9B, with about 9.4B BF16 parameters in the Qwen3.5 multimodal architecture, loaded through Transformers for image-text-to-text.
Agent S
Simular's open-source framework for computer-use agents that click, type and scroll through desktop and web apps on macOS, Windows and Linux; its third generation, Agent S3, reports 72.6% on OSWorld.
AgentProg
Android GUI-agent framework that keeps long-running task context in structured programs, variables and control flow, with a CLI and AndroidWorld integration.
AssistGUI
LLM-based assistant for automating work in desktop productivity software by watching the screen and issuing mouse and keyboard commands; its repository says the code will be released later.
Auto-GUI / Auto-UI
Screenshot-based mobile agent implementation with training and inference code for chain-of-action prediction.
CAAP Agent
Screenshot-driven agent implementation for MiniWoB++ and WebShop, using a visual observer and context-aware prompts to issue mouse and keyboard actions.
CHOP
Mobile automation framework that uses reusable basis subtasks to constrain and refine planning between user goals and executable actions.
CoAT research implementation
Research scripts that generate screen descriptions, action reasoning and expected outcomes, then predict Android GUI actions using the resulting Chain-of-Action-Thought context.
COLA demo
Research demonstration of collaborative Windows GUI automation with dynamic task scheduling and recovery mechanisms.
Cradle
Framework in which foundation models control games and software from screenshots alone, acting through keyboard and mouse, shown on RDR2, Stardew Valley, Cities: Skylines and Dealer's Life 2.
D-PoT evaluation code
Offline prompting and evaluation code for Dynamic Planning of Thoughts on Android-in-the-Wild, including action extraction and comparison with reference actions.
GUI-CIDER research code
Released data-synthesis and evaluation scripts that distill planning and causal GUI knowledge into text for mid-training mobile interface agents.
GUI-ReWalk
A desktop trajectory-generation framework that moves from stochastic GUI exploration to inferred goals and multi-stage task completion, with retrospective reasoning annotations.
GUIPivot
Query-inference training tools connecting screenshot grounding with GUI action reasoning, including preprocessing, query refinement and offline single-step evaluation on AndroidControl and AITZ.
LiteWebAgent
Modular web-agent framework with browser control, planning, workflow memory, and tree-search components, plus web and extension interfaces.
MobA
An Android agent that combines global task planning and memory with a local action executor, using reflection to revise mobile interaction steps.
Mobile-Agent-E code component
Android automation component with hierarchical planning, reflection and persistent tips/shortcuts learned across task sequences.
MobileGPT
An Android client and Python-server agent that learns reusable app subtasks through exploration, selection, derivation and memory recall.
Mobilerun (formerly Droidrun)
A framework that combines screenshots and accessibility state with agent tools for mobile-device tasks through command-line and Python interfaces.
OS-Copilot
Open-source library for generalist agents acting on an operating system's web, terminals, files and third-party apps, with the FRIDAY assistant, which takes custom tools and self-learns Excel tasks.
PC-Agent
Human-cognition-transfer framework for PC agents: PC Tracker logs human computer use, cognition completion turns logs into cognitive trajectories, and a planner works with a grounding agent.
PC-Agent (X-PLUG component)
Multi-agent desktop automation component for Windows and macOS, combining active perception, task decomposition and reflection for workflows spanning applications.
Plan-and-Act
A web-agent framework that separates high-level planning from action execution, with replanning and synthetic planner-data generation components.
RCI Agent
A MiniWoB++ agent that uses explicit and implicit recursive criticism-and-improvement prompts to refine action plans and ground actions to browser state.
ScreenAgent
Environment and agent in which a vision-language model controls real desktops over VNC with mouse and keyboard in plan, act and reflect stages, plus a hand-annotated dataset of daily computer tasks.
Self-MAP
A conversational web-agent implementation with candidate ranking and memory-assisted action planning, including optional memory simplification, refinement and self-reflection modules.
StateAct
State-tracking prompts and experiment runners for language agents, including a WebShop implementation alongside text-based environments.
Synapse
A computer-control research implementation that retrieves example trajectories from memory, abstracts task-relevant state and prompts an agent to navigate browser tasks.
VisionTasker
An Android automation implementation that translates screenshot-based UI understanding into language descriptions for step-by-step LLM planning and action execution.
WebDreamer
World-model and planning components that simulate web-action outcomes, with linked training data and model checkpoints.
WorkForceAgent-R1
Web-task reward functions, WorkArena data processing and GRPO training configurations for reasoning-oriented language agents.
Building AI Browser Agents
Browser-agent course with worked lessons on structured web extraction and multi-step browser interaction, followed by AgentQ search and self-correction concepts.
Showing 241–283 of 283 resources.
Get full records and evidence through the topic export manifest. Source records can be passed to the standard RAG and citation exporters after cloning the catalog.