Skip to content
Recaply.
Sign inSubmit a tool

DirectoryOpen alternatives

Open source alternatives to Together AI

2 open source tools do the job of Together AI. The most starred is Ollama, with 186k stars. Verified on GitHub. About Together AI

Together AI homepage
Together AIPaid
Ollama homepage
Ollama186k stars · MITGitHub

All 2 alternatives

Questions about alternatives to Together AI

What is the best open source alternative to Together AI?

By GitHub stars it is Ollama, with 186,895 stars and a commit on 14 Nov. Choose Ollama when you want open models on your own machine for free instead of paying for hosted inference. Next come Modular (30,134 stars).

Is there a free alternative to Together AI?

Yes. The code of all 2 is public under MIT or Apache 2.0 WITH LLVM-exception, so you can use them with no licence fee. Running one yourself costs the server and your time to look after it, and some makers also sell a hosted plan.

How do I choose between them?

Start from the job you use Together AI for. Choose Modular when you want one inference stack you can self-host for free across GPUs, CPUs and ASICs.

Which Together AI alternatives can I host on my own server?

All 2: Ollama and Modular. Each tool's page says what it needs to run.

Which ones are still being worked on?

All 2 we track had a commit in the last 30 days, among them Ollama and Modular. A recent commit shows the project is kept up, not that it will stay that way.

What licences do they use?

MIT (1), Apache 2.0 WITH LLVM-exception (1). MIT, BSD and Apache let you change and reuse the code freely.

What do I lose by leaving Together AI?

The hosting. Together AI's maker runs the servers for you; with an open source tool the updates, backups, security fixes and support are yours, unless you take the maker's hosted plan. Features differ too, so check what each one imports and exports before you move your data.