agent-desktop (Vercel Labs)
A Rust CLI + C library giving AI agents computer use without screenshots: it reads the OS accessibility tree and returns it as JSON.
About
From Vercel Labs: a Rust CLI + C library giving AI agents computer use without screenshots or pixel matching: it reads the OS accessibility tree (AX on macOS, UI Automation on Windows, AT-SPI on Linux), returns it as JSON with a stable ref per actionable element; the agent clicks/types on a ref and re-snapshots to verify. 60 commands, MCP server (agent-desktop mcp), no model inside. macOS 13+, Windows 10 1809+, Linux Ubuntu 24.04+. Needs OS Accessibility permission on macOS.
npm install -g agent-desktopAlso via Homebrew:
brew install agent-desktopAdd the skill:
npx skills add https://github.com/vercel-labs/agent-desktop --skill agent-desktopMore in Agents & Automation
View all
Craft Anything
Point Claude Code at a website, app or game and it rebuilds your own version from scratch — clean-room, comparing at three screen widths.
Claude Code Action
Anthropic's official GitHub Action — Claude Code answers @claude mentions, reviews PRs, implements fixes and triages issues in your repos.
Strix
Open-source autonomous AI pentesting: multi-agent teams find OWASP Top 10 flaws and validate each with a working PoC exploit.