How-To Series · 4: Eyes, Ears, Voice

Computer Use

Let Hermes drive your desktop in the background, with no cursor warp or focus steal.

After this videoHermes can operate your real desktop apps while you keep working alongside it

Computer Use lets Hermes click, type, scroll, and drag on macOS, Windows, and Linux in the background. Your real cursor never moves and focus never changes. It works with any tool-capable model over MCP to the open-source cua-driver. Install with hermes computer-use install, grant platform prereqs, start with hermes -t computer_use chat, and triage with hermes computer-use doctor. Destructive actions require approval and dangerous key combos and shell payloads are hard-blocked.

About these resources. This episode explains how to set up and use Computer Use in Hermes. The Sources block names the Hermes docs page that backs every claim.

Sources · What this video distills

1 docs page · every command below traces to one of them

Primary guide

Computer Use

Commands shown · Copy and paste

each shows the source doc it came from

Install the cua-driver background driverfrom source ↗

hermes computer-use install

Start a session with the toolset enabledfrom source ↗

hermes -t computer_use chat

Run the per-check health matrixfrom source ↗

hermes computer-use doctor

Going deeper · Related Hermes docs

further reading · not sources of facts shown above

Headless Chromium for web-only tasks, no desktop overhead.

Web Search & Extract

General web search and page extraction for non-desktop tasks.

Next in the series · Episodes that build on this