vercel-labs/agent-desktop
agent-desktop gives an AI agent computer use on macOS, Windows and Linux without screenshots or pixel matching. It reads the accessibility tree of a desktop application as JSON, returns a reference for every actionable element, and lets the agent click or type on that reference before reading the UI again. It ships as a CLI and a C library, contains no model of its own and includes native binaries for x64 and ARM64.
Maintenance activity