How-To Series · 8: Provider Plumbing
Run Hermes with Ollama
Zero API costs. Full functionality. Run Hermes entirely on your own machine with Ollama and open-weight models like Gemma 4.
After this videoYou can run Hermes entirely on your own machine with zero API costs.
This tutorial shows you how to set up Hermes Agent running entirely on your own hardware using Ollama as the model backend. No API keys, no subscriptions, no data leaving your machine. Once configured, Hermes works exactly like it does with OpenRouter or Anthropic — terminal commands, file editing, web browsing, delegation — but the model runs locally.
About these resources. This guide walks you through setting up Hermes with Ollama. The Sources block names every Hermes docs page that backs a claim in the script. For more information on running Hermes with different providers, see the related guides.
Sources · What this video distills
3 docs pages · every command below traces to one of themCommands shown · Copy and paste
each shows the source doc it came fromcurl -fsSL https://ollama.com/install.sh | shollama --version
curl http://localhost:11434/api/tagsollama pull gemma4:31bcurl http://localhost:11434/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "gemma4:31b",
"messages": [{"role": "user", "content": "Say hello"}],
"max_tokens": 50
}'hermes setuphermesGoing deeper · Related Hermes docs
further reading · not sources of facts shown aboveRun Hermes with Nous Portal
Alternative to local models - use Nous Portal subscription for cloud models with no setup.
Configuration Guide
Detailed guide on configuring Hermes with different providers and settings.
Tool Gateway
Learn about Hermes' tool gateway for web search, image generation, and browser automation.