Advanced

Relays and aggregators

This page is for you if you want many models on one key, lower prices than the model makers post, or a way to pay without a card. A relay can give you all three. The price is that one more company sits between your agent and the model, and that company can read everything your agent sends.

The page explains what a relay can see, compares the paid relays this guide checked, and walks through connecting one to your agent. It ends with how to judge a relay before you hand it money or data.

Applies to: Agent Zero, Hermes Agent, OpenClaw, Goose, NanoClaw, QwenPaw, Eigent, Atomic Agent, and OpenManus. Everfern has no relay setting: its only address box is for a local Ollama or LM Studio server and takes no key, though OpenRouter is one of its named providers.

What a relay is

Most agents can talk to any service that speaks the same request format as OpenAI's API. To switch, you change two settings: the address the agent sends requests to, usually called the base URL, and the key it sends along. A relay is a service at a different address that accepts those requests and passes them on to whoever actually runs the model.

An address that speaks OpenAI's format does not mean OpenAI runs it. The relay's own terms and privacy policy apply, not the model maker's.

Relays come in two broad kinds.

For comparison, OpenRouter is a widely used aggregator that says it bills at each provider's list price and charges its fee on credit purchases instead, 5.5% for card payments. It works the same way in an agent and carries the same basic question: who else can read your prompts?

What a relay can see

A relay sees everything your agent sends, and an agent sends far more than your typed message. Each step can include the agent's instructions, the conversation so far, files it opened, web pages it read, command output, and notes from its memory. If the agent can reach a folder, whatever it reads there can end up on the relay's servers.

The relay then passes the request to an upstream provider, which sees it too. Most relays choose that provider for you, and some do not say who it is.

A relay also decides which copy of a model answers. NanoGPT's docs say providers can serve a model at different weight precisions, and they offer filters "when you need to avoid lower-precision provider routes for a model". So the default route can be a more compressed copy than another provider selling the same name. RelaySwitch's own daily check marked 20 models "changed" on the day it was checked, meaning what answered under that name was not what answered before. The apiprice directory, which lists discount relays, says a price sticker does not show whether the model you received is the one you named.

Warning: Keep passwords, private code, customer records, medical or legal documents, and anything you would not paste into a public chat away from a relay. That includes files your agent can open on its own.

Your relay key is a target too. Anyone who has it can spend your balance, so store it the way your agent's guide says to store an API key.

The relays this guide checked

Prices and claims below are what each site said on 14 November 2026. "Their claim" means this guide could not check it independently, and nothing here was tested by sending a prompt.

Service How you pay Price claim Who can read your prompt Risk
The model maker's own API, for comparison Card, pay as you go The list price, set by the maker The model maker Safe official. Surprise bill without a spend limit.
NanoGPT Top up from $1 by card or $0.10 in crypto. Optional $12 a month for open-source models. List price with no markup, their claim. Pinning a provider adds 5%. NanoGPT, then the provider it routes to Privacy risk. The default route can be a more compressed copy of a model.
RelaySwitch Prepay $10 to $500 by card or crypto. No subscription, and credit does not expire, but top-ups are not refundable. Below list on its flagship rows, such as half price on Claude Fable 5.2, their claim. RelaySwitch, then the machine that runs the model. They claim not to store messages. Privacy risk. Their own check marked 20 models changed that day.
Chutes Top up, then pay per token. No free tier and no minimum. "No markup," their claim. Chutes in memory, then a third-party platform for standard models. Locked "confidential" models claim more. Privacy risk on standard models.
Discount relay, with OhMyGPT as the example Prepaid credits at 250,000 per dollar Below list on 96 models, using a blended price. The shop, then an upstream you may not see. They reserve the right to store and review it. Ban risk: an upstream account can be closed, stranding your balance. Privacy risk. No refunds.

A prepaid balance has one real advantage: it is its own spend limit. When it runs out, the agent stops, so a stuck agent cannot spend more than you loaded.

NanoGPT

NanoGPT's pricing page offers pay as you go at $0 a month, or $12 a month for included use of open-source models. The $12 plan covers 60 million input tokens a week, free output on the included models, and 100 images a day, and it resets every Monday at 00:00 UTC. It does not include most closed models, naming Claude, GPT, Gemini, and Grok, which keep billing your balance.

The page claims text is billed at list price with no markup. Two opt-in charges sit beside that claim: choosing a specific provider adds 5%, and bringing your own key costs 5% of the normal price. Its payment page says crypto "needs no ID or account" and that card payments are less private, because Stripe processes them.

NanoGPT routes each request to a provider by default. Its docs say provider prices and availability can change between when you look and when you send. It runs a token-count check on its most-used models, but says that check does not cover every model.

RelaySwitch

RelaySwitch prices every model per million tokens and takes prepaid top-ups of $10, $25, $50, $100, $250, or $500. You pay by card or in USDT, USDC, BTC, ETH, or SOL. Its no-identity-check page says an email address opens the account, and that request and response bodies are not stored. Those are their claims, and the machine that runs the model still receives your prompt.

Its comparison table showed Claude Opus 5.5 at $2.716 input and $9.70 output per million tokens, against a list price it gave as $4 and $20. A daily "proof" page sends the same test prompt to each model and flags any change in the answer. On the day the research checked it, 325 of 358 models were stable, 20 had changed, and 13 did not answer. That is their own test of their own service, not an outside audit.

Its own pages also disagreed about the size of the catalog, giving three different model counts at once, and the counts moved during the day. Treat any single number as approximate.

Chutes

Chutes says "Pay per token. No subscription, no minimum, no markup." It has no free tier, and it no longer sells monthly plans. It takes more than 25 payment methods through Stripe, including cards, crypto, and bank transfers, plus the TAO token. One row on its live table was Qwen/Qwen3.8-27B-TEE at $0.039 input and $1.25 output per million tokens.

Its privacy page splits models in two. Standard models are often served by third-party platforms, and "A Model Provider's own staff and systems can access content while they process it". Those providers' retention runs from near zero to "generally up to 30 days", which Chutes says it cannot guarantee. Confidential models, marked in the catalog and usually named with TEE, run inside hardware enclaves designed to keep the machine's operator from reading your content.

Note: Chutes says an automatic or fallback route may pick a standard model. If you need the confidential claim on every request, name a confidential model by its exact ID.

Discount relays, with OhMyGPT as the example

Shops in China and elsewhere sell a prepaid key and tell you to change your agent's address, often at a price below the model maker's list. OhMyGPT, run by DogeNet LLC according to its own terms, is a long-running shop with public price pages. Naming it documents those pages; it is not a recommendation.

Its homepage says one key reaches 294 models, and that it picks a supplier and switches if one fails. It says 96 models are below the official price, but that comparison blends cache hits, input, and output in a 7:2:1 ratio. Billing is in credits at 250,000 per dollar, and each line rounds up to a whole credit. Its own example shows a tiny request costing 3 credits against a list price of 4.

Its terms refuse refunds except when the company cannot continue service because of force majeure. They also grant DogeNet LLC a permanent, worldwide, sublicensable copyright license over the prompts you enter and the material generated from them. Its privacy policy reserves the right to store, review, and investigate your messages, and says the upstream may record them as well.

Its cost docs add one quirk: when your balance runs low, it shrinks the reply limit instead of returning an error. Long answers can then stop early, looking just like a normal length cutoff, until you top up. The only sign is a response header that most agents never show you.

The apiprice directory says reselling can conflict with the model makers' own terms. It points to OpenAI's rules against reselling API access and against use outside supported countries, and to Anthropic's rule against resale without approval. When an upstream account is closed, the route dies, and the person holding prepaid credit has no contract with the model maker.

Connect an agent to a relay

The general steps

  1. Read the relay's terms, privacy policy, and refund policy, using the checklist in How to judge a relay.
  2. Create an account and top up the smallest amount allowed. NanoGPT starts at $1 by card, RelaySwitch at $10, and Chutes has no minimum.
  3. Create an API key in the relay's dashboard. Copy it somewhere safe, because many dashboards show it only once.
  4. Find the relay's base URL in the table below, and copy a model ID exactly as the relay's model list shows it.
  5. In your agent, add a custom OpenAI-compatible provider with that base URL, your key, and the model ID. The per-agent notes below say where.
  6. Send a harmless test message, such as "Reply with the word ready."
  7. Open the relay's usage or billing page and check the charge and the model name on that request.

What you should see a reply in your agent, and one small charge on the relay's usage page under the model you picked.

Relay OpenAI-compatible base URL Other formats its docs mention
NanoGPT https://api.nano-gpt.com/api/v1 Responses, and Anthropic-style messages at /api/v1/messages
RelaySwitch https://api.relayswitch.io/v1 Responses, Anthropic Messages, and Gemini
Chutes https://llm.chutes.ai/v1 This guide could not confirm others.
OhMyGPT https://api.ohmygpt.com/v1 Responses and Anthropic Messages

Model IDs differ between relays, even for the same model. Chutes uses names like Qwen/Qwen3.8-27B-TEE, while RelaySwitch uses names like claude-sonnet-5-5. Copy the ID from the relay you are using, not from another site.

Per-agent notes

Agent Where the address goes
Agent Zero Pick the provider Other OpenAI compatible, then enter the relay's base URL, your key, and the model ID. Set both the Main and Utility models.
Hermes Agent Run hermes model, choose Custom endpoint (self-hosted / VLLM / etc.), and enter the URL, key, and model name. Or set provider: custom and model.base_url in ~/.hermes/config.yaml.
OpenClaw Add an entry under models.providers in ~/.openclaw/openclaw.json, as in the example below.
Goose Go to Settings → Models → Configure providers → Add Custom Provider. Choose OpenAI Compatible, fill in API URL, your key, and the model names, then click Create Provider.
NanoClaw Its Claude setup takes a Claude-format address in ANTHROPIC_BASE_URL in .env. Its OpenCode add-on takes an OpenAI-compatible address instead.
QwenPaw Go to Settings → Models and fill in the Base URL field.
Eigent Use bring-your-own-key and enter the API key, the endpoint, and the model name.
Atomic Agent In the desktop app, open Settings › Models › Cloud providers, click Add provider, choose OpenAI-compatible API (custom base URL), and enter the relay's address, your key, and the model ID. In the config file, this is an llm.providers[] entry with "kind": "openai-compatible" and the address as baseUrl.
OpenManus Set base_url, api_key, and model in config/config.toml, as in the example below.
Everfern No relay setting. In v1.3.0, Server URL (optional) appears only for local Ollama or LM Studio and has no key field. Its cloud list is fixed, and includes OpenRouter.

A few details matter for specific agents. Agent Zero runs in Docker, but a relay is on the internet, so its normal address works and you do not need the host.docker.internal trick used for local models. This guide could not confirm the exact name of Agent Zero's address field.

Hermes rejects models whose context window is smaller than 64,000 tokens, so check the relay's listing for the model's context size. For NanoClaw, NanoGPT, RelaySwitch, and OhMyGPT all mention Anthropic-format support, but this guide could not confirm the exact value each one wants in ANTHROPIC_BASE_URL. Check the relay's own Claude Code setup page for that value.

OpenClaw's docs show a custom provider shaped like this, here filled in for NanoGPT. The docs prefer an environment-variable or secret reference over a key typed into the file. This guide could not confirm the exact syntax, so check OpenClaw's secrets page before you save a real key.

{
  models: {
    providers: {
      "nanogpt": {
        baseUrl: "https://api.nano-gpt.com/api/v1",
        apiKey: "YOUR-RELAY-KEY",
        api: "openai-completions",
        models: [{ id: "MODEL-ID-FROM-THE-RELAY" }],
      },
    },
  },
}

OpenManus reads its model settings from config/config.toml. This example uses OhMyGPT's address.

[llm]
model = "MODEL-ID-FROM-THE-RELAY"
base_url = "https://api.ohmygpt.com/v1"
api_key = "YOUR-RELAY-KEY"

What you should see after a restart, the agent lists or accepts the relay's model, and the test message from the general steps gets a reply.

How to judge a relay before you pay

Spend ten minutes on these questions before you top up. A relay that will not answer them in writing is telling you something.

A relay that passes these checks is still a third party with your prompts. The checks lower the risk; they do not remove it.

What this guide does not cover

Some free or cheap routes work by spending other people's money or access. This guide names them only to explain why it skips them.

None of these is a cheaper version of a relay. Each one makes someone else pay for your agent without their consent.

Trade-offs: when a relay makes sense

A paid aggregator instead of the model maker's API. You send your agent's requests through NanoGPT, RelaySwitch, or Chutes.

A discount relay. You buy prepaid credit below list price from a shop such as OhMyGPT.

A relay for an agent that can read your files. The relay sees whatever the agent opens, not just what you type.

Chutes confidential models. You name a model marked as confidential instead of letting Chutes choose.

Before you choose, run each option past the three questions in Safety versus capability.

Sources

Checked 14 November 2026.

Next

Uncensored models, and why they are a poor fit for an agent, are on Uncensored models.