MAI-UI inference and evaluation code
Published MAI-UI grounding and navigation-agent implementations with inference demos and evaluation scripts.
Android
Tool integration
Source-reviewed research and assets tagged with Tool integration.
Membership follows reviewed tags; it does not establish a dependency between neighboring records. Dates preserve source precision. Annotations retain their original language.
Mobile Harness
Portable agent instructions and integration tooling for local or cloud phone control through mobilerun-core.
AndroidiOS
Mobile Next MCP
An MCP server exposing mobile accessibility snapshots, screenshots and device interactions across real devices, simulators and emulators.
AndroidiOS
Mobilerun (formerly Droidrun)
A framework that combines screenshots and accessibility state with agent tools for mobile-device tasks through command-line and Python interfaces.
AndroidiOS
Mobilerun Portal (formerly Droidrun Portal)
An Android accessibility service that exposes UI-element inspection, device-control interfaces and screen feedback to mobile automation agents.
Android
OculiX (SikuliX continuation)
A maintained continuation of SikuliX that locates on-screen targets with image matching and OCR, drives desktop or Android interfaces, and exposes scripting and optional MCP interfaces.
DesktopWindowsmacOSLinuxAndroid
OpenAgents Web Agent
The OpenAgents browser-control component, connecting a Chrome extension to a web agent and local chat platform for navigating sites and completing interface tasks.
Web
OpenMobile-2 code
Evaluation adapters and training guidance for OpenMobile-2 across Android emulators and browser-rendered mobile simulation.
AndroidWeb
OS-Copilot
Open-source library for generalist agents acting on an operating system's web, terminals, files and third-party apps, with the FRIDAY assistant, which takes custom tools and self-learns Excel tasks.
Desktop
Playwright MCP
MCP server that lets LLM clients drive Playwright browsers through structured accessibility snapshots instead of screenshots, with opt-in vision, PDF and devtools capabilities.
Web
SheetCopilot
Spreadsheet automation agent for Windows/Excel, with benchmark assets and a separately released headless Ubuntu evaluation backend.
DesktopWindowsLinux
SkillWeaver
A web-agent framework that explores sites, synthesizes reusable interaction APIs and builds a skill library for later tasks.
Web
WebLlama
Training, evaluation and integration tooling for dialogue-guided web agents, including Llama fine-tuning workflows and BrowserGym examples built around WebLINX.
Web
WebMarker
A browser library that labels interactive elements and their boxes for visual prompting, preserving element mappings that automation code can use to execute selected actions.
Web
Windows-MCP
A Windows MCP bridge exposing application, window, keyboard and mouse operations plus native UI-state inspection for agents.
WindowsDesktopWeb
Showing 121–136 of 136 resources.
Get full records and evidence through the topic export manifest. Source records can be passed to the standard RAG and citation exporters after cloning the catalog.