规划

已审阅并标注「规划」的研究与资产。

条目依据已审阅标签归类,同一主题不表示资源之间存在依赖关系。日期保留来源精度,注释保留原语言。

模型

OpenCUA 32B

A Qwen2.5-VL-based computer-use checkpoint that combines screenshot history with planning and grounded executable actions.

桌面LinuxWindowsmacOS
模型

OpenCUA 72B

A Qwen2.5-VL-based computer-use checkpoint that combines screenshot history and reflective reasoning to predict executable desktop actions.

桌面LinuxWindowsmacOS
模型

ScaleCUA 7B

A Qwen2.5-VL-based computer-use checkpoint with direct grounding and agent action modes across desktop, mobile and web interfaces.

网页桌面AndroidLinux
模型

UI-TARS

Native GUI agent models; UI-TARS-1.5 adds reinforcement-learned reasoning before acting and an open 7B checkpoint, and UI-TARS-2 extends to games, code and tool use.

跨平台
模型

UI-TARS 1.5 7B

UI-TARS 1.5 GUI-agent checkpoint in the Qwen2.5-VL architecture with about 8.3B parameters stored in FP32, released under Apache-2.0 for English image-text-to-text use in Transformers.

跨平台
模型

UI-Venus

GUI agent model family; UI-Venus-2, at 9B and 27B, acts on mobile, web and desktop in one end-to-end agent, trained with keypoint-based multi-judge task verification.

跨平台
模型

UI-Venus 2 9B

UI-Venus 2 GUI-agent checkpoint fine-tuned from Qwen3.5-9B, with about 9.4B BF16 parameters in the Qwen3.5 multimodal architecture, loaded through Transformers for image-text-to-text.

跨平台

工程与产业

32回到顶部 ↑
智能体

Agent S

Simular's open-source framework for computer-use agents that click, type and scroll through desktop and web apps on macOS, Windows and Linux; its third generation, Agent S3, reports 72.6% on OSWorld.

桌面
框架

AgentProg

Android GUI-agent framework that keeps long-running task context in structured programs, variables and control flow, with a CLI and AndroidWorld integration.

Android
智能体

AssistGUI

LLM-based assistant for automating work in desktop productivity software by watching the screen and issuing mouse and keyboard commands; its repository says the code will be released later.

桌面
智能体

CAAP Agent

Screenshot-driven agent implementation for MiniWoB++ and WebShop, using a visual observer and context-aware prompts to issue mouse and keyboard actions.

网页
框架

CHOP

Mobile automation framework that uses reusable basis subtasks to constrain and refine planning between user goals and executable actions.

Android鸿蒙
智能体

Cradle

Framework in which foundation models control games and software from screenshots alone, acting through keyboard and mouse, shown on RDR2, Stardew Valley, Cities: Skylines and Dealer's Life 2.

桌面
框架

GUI-ReWalk

A desktop trajectory-generation framework that moves from stochastic GUI exploration to inferred goals and multi-stage task completion, with retrospective reasoning annotations.

桌面Linux
框架

GUIPivot

Query-inference training tools connecting screenshot grounding with GUI action reasoning, including preprocessing, query refinement and offline single-step evaluation on AndroidControl and AITZ.

Android
智能体

MobA

An Android agent that combines global task planning and memory with a local action executor, using reflection to revise mobile interaction steps.

Android
智能体

MobileGPT

An Android client and Python-server agent that learns reusable app subtasks through exploration, selection, derivation and memory recall.

Android
智能体

OS-Copilot

Open-source library for generalist agents acting on an operating system's web, terminals, files and third-party apps, with the FRIDAY assistant, which takes custom tools and self-learns Excel tasks.

桌面
智能体

PC-Agent

Human-cognition-transfer framework for PC agents: PC Tracker logs human computer use, cognition completion turns logs into cognitive trajectories, and a planner works with a grounding agent.

桌面
框架

Plan-and-Act

A web-agent framework that separates high-level planning from action execution, with replanning and synthetic planner-data generation components.

网页
智能体

RCI Agent

A MiniWoB++ agent that uses explicit and implicit recursive criticism-and-improvement prompts to refine action plans and ground actions to browser state.

网页
智能体

ScreenAgent

Environment and agent in which a vision-language model controls real desktops over VNC with mouse and keyboard in plan, act and reflect stages, plus a hand-annotated dataset of daily computer tasks.

桌面
框架

Self-MAP

A conversational web-agent implementation with candidate ranking and memory-assisted action planning, including optional memory simplification, refinement and self-reflection modules.

网页
框架

StateAct

State-tracking prompts and experiment runners for language agents, including a WebShop implementation alongside text-based environments.

网页相关研究
框架

Synapse

A computer-control research implementation that retrieves example trajectories from memory, abstracts task-relevant state and prompts an agent to navigate browser tasks.

网页
智能体

VisionTasker

An Android automation implementation that translates screenshot-based UI understanding into language descriptions for step-by-step LLM planning and action execution.

Android

学习资源

1回到顶部 ↑

第 241–283 条,共 283 条资源。

通过主题导出清单获取完整记录和证据。克隆目录后,可将主题记录直接交给标准 RAG 与引用导出工具。