LLM Gateway

What is LLM Gateway?

One OpenAI-compatible endpoint for many model providers, with spend tracking, failover and caching.

Who is LLM Gateway best for?

LLM Gateway is best for product teams that use several LLM providers and want one API with cost tracking.

• Switching models without rewrites

  It accepts OpenAI-style requests, so moving to another provider means changing the base URL and the model name.

• Watching LLM spend

  Dashboards split requests, tokens and cost by model, provider and API key, and spend caps stop a key at its limit.

• Staying up when a provider fails

  When a provider errors, times out or rate-limits, the gateway retries the same model on another provider, up to twice.

• Keeping traffic in-house

  The AGPLv3 core runs inside your own network with Docker or Kubernetes.

How much does LLM Gateway cost?

LLM Gateway is free to self-host and free in its cloud with your own provider keys; paying through its credits adds a 5% fee to each provider's list price.

Enterprise is priced by sales after a 30-day trial. It adds volume discounts on credits, SSO, guardrails, audit logs, a 99.9% uptime SLA and 30 days of full request and response retention, which is billed at $0.01 per million tokens. Credit purchases with less than 10% used can be refunded within 14 days. Full pricing on llmgateway.io. We checked these prices on 8 Nov 2026.

How do readers rate LLM Gateway?

No one has rated LLM Gateway yet. Be the first.

Is LLM Gateway open source?

Yes. LLM Gateway's code is public under the AGPL 3.0 licence, so you can read it, change it and run it yourself.

How do I connect LLM Gateway to my AI agent?

LLM Gateway MCP is LLM Gateway's official MCP server. Add it to your agent once, then ask it to track spend and model usage in your LLM Gateway account.

Gives your agent read access to your LLM Gateway stats: how much you spent, which models and providers get the most calls and which coding apps send them.

Claude CodeCursorCodexGitHub Copilot

Terminal

$ claude mcp add --transport http llm-gateway https://api.llmgateway.io/mcp

Claude Code connects to LLM Gateway over the web.

Run /mcp and sign in to LLM Gateway in the browser.

Then ask your agent

• Show my spend for the last 30 days
• Find the model I called most this week
• Break down October costs by provider

Runs

On the web

Sign-in

OAuth

Checked

Answered 13 Nov

Guide

docs.llmgateway.io

What are the best LLM Gateway alternatives?

Three tools on Recaply do LLM Gateway's job.

LiteLLMOpen Source

Self-hosted proxy that puts 100+ LLM providers behind one OpenAI-style API, with keys and budgets.

PortkeyOpen Source

A gateway to 1,600 LLMs with monitoring and governance.

APIParkOpen Source

An open-source gateway for managing multiple LLMs.

Questions about LLM Gateway