MAI-UI inference and evaluation code
Published MAI-UI grounding and navigation-agent implementations with inference demos and evaluation scripts.
已审阅并标注「工具集成」的研究与资产。
条目依据已审阅标签归类,同一主题不表示资源之间存在依赖关系。日期保留来源精度,注释保留原语言。
Published MAI-UI grounding and navigation-agent implementations with inference demos and evaluation scripts.
Portable agent instructions and integration tooling for local or cloud phone control through mobilerun-core.
An MCP server exposing mobile accessibility snapshots, screenshots and device interactions across real devices, simulators and emulators.
A framework that combines screenshots and accessibility state with agent tools for mobile-device tasks through command-line and Python interfaces.
An Android accessibility service that exposes UI-element inspection, device-control interfaces and screen feedback to mobile automation agents.
A maintained continuation of SikuliX that locates on-screen targets with image matching and OCR, drives desktop or Android interfaces, and exposes scripting and optional MCP interfaces.
The OpenAgents browser-control component, connecting a Chrome extension to a web agent and local chat platform for navigating sites and completing interface tasks.
Evaluation adapters and training guidance for OpenMobile-2 across Android emulators and browser-rendered mobile simulation.
Open-source library for generalist agents acting on an operating system's web, terminals, files and third-party apps, with the FRIDAY assistant, which takes custom tools and self-learns Excel tasks.
MCP server that lets LLM clients drive Playwright browsers through structured accessibility snapshots instead of screenshots, with opt-in vision, PDF and devtools capabilities.
Spreadsheet automation agent for Windows/Excel, with benchmark assets and a separately released headless Ubuntu evaluation backend.
A web-agent framework that explores sites, synthesizes reusable interaction APIs and builds a skill library for later tasks.
Training, evaluation and integration tooling for dialogue-guided web agents, including Llama fine-tuning workflows and BrowserGym examples built around WebLINX.
A browser library that labels interactive elements and their boxes for visual prompting, preserving element mappings that automation code can use to execute selected actions.
A Windows MCP bridge exposing application, window, keyboard and mouse operations plus native UI-state inspection for agents.
第 121–136 条,共 136 条资源。
通过主题导出清单获取完整记录和证据。克隆目录后,可将主题记录直接交给标准 RAG 与引用导出工具。