What is KoboldAI?
Run models locally with an API server and light interface.
Who is KoboldAI best for?
KoboldAI is best for hobbyists and developers who want to run open language models on their own computer.
Running models offline
KoboldCpp is a single executable for Windows, Mac and Linux that loads GGUF models on a CPU or GPU with nothing to install.
A local API for other apps
It serves endpoints compatible with the OpenAI, Ollama and KoboldCpp APIs, so other tools can use a model running on your machine.
Story writing and roleplay
KoboldAI Lite has chat, adventure, instruct and story modes, with memory, world info, author's notes and Tavern character cards.
Trying it without hardware
The free KoboldAI Lite web app runs on volunteer AI Horde workers, or connects to online providers such as OpenRouter.
How much does KoboldAI cost?
KoboldAI is free and open source, with no paid tier: KoboldCpp is a free download, and the KoboldAI Lite interface runs free in the browser.
- Open source under the AGPL-3.0 licence
- KoboldCpp binaries for Windows, Mac and Linux
- KoboldAI Lite web app free on koboldai.net
KoboldAI has no pricing page or paid plan; KoboldCpp downloads come from its GitHub releases, and koboldai.net serves KoboldAI Lite free. Running it on a rented cloud GPU, such as the RunPod image the makers provide, is billed by that provider, not by KoboldAI. Full pricing on koboldai.com. We checked these prices on .
How do readers rate KoboldAI?
No one has rated KoboldAI yet. Be the first.
Sign in to rate. One rating per account.
Is KoboldAI open source?
Yes. KoboldAI's code is public under the AGPL 3.0 licence, so you can run it on your own server.
On GitHub
12,298stars
- Last commit
- 11 Nov
- Repository age
- 3 years
- Latest release
- 31 Oct
- Licence
- AGPL 3.0
- Self-hosted
- Yes
- Repository
- LostRuins/koboldcpp
What are the best KoboldAI alternatives?
KoboldAI is an open source alternative to Msty. Jan, Cherry Studio, LLMWare and 2 more do the same job and are open source too.
MstyFreeLocal and cloud models in one private workspace.
JanOpen SourceDesktop app that runs open AI models offline on your computer or connects to cloud model APIs.
Cherry StudioOpen SourceDesktop AI workspace that chats with many models, runs agents and searches your own documents.
LLMWareOpen SourcePrivate AI workflows with 250 models, no code.
OllamaOpen SourceRun open models on your own machine with one command.
AnythingLLMOpen SourceChat with your documents using local or cloud models, with agents, in a desktop app or Docker.
Questions about KoboldAI
What is KoboldAI?
Run models locally with an API server and light interface.
Who is KoboldAI for?
KoboldAI is best for hobbyists and developers who want to run open language models on their own computer.
Is KoboldAI free?
Yes. KoboldAI has a free plan: open source under the AGPL-3.0 licence.
Is KoboldAI open source?
Yes. KoboldAI's code is public under the AGPL 3.0 licence, so you can run it on your own server.
What are the best KoboldAI alternatives?
The closest alternatives on Recaply are Msty, Jan, Cherry Studio, LLMWare, Ollama and AnythingLLM.
Where can I try KoboldAI?
On its official website, koboldai.com.
Do I need a GPU to run KoboldAI?
No. KoboldCpp runs on a CPU alone, and a GPU only speeds it up by holding some of the model's layers in video memory. Without suitable hardware you can use the free KoboldAI Lite web app or connect KoboldCpp to an online provider.
Does KoboldAI come with models?
No. KoboldCpp does not ship with any models; you download GGUF model files separately, for example from Hugging Face, and load one when you start it. The README suggests a small all-round model for beginners and older ones for creative writing.
SillyTavern
LibreChat
LM Studio
ZeroClaw
BoltAI
Pulze.ai