What is Promptfoo?
Red teaming and vulnerability tests in your CI/CD.
Who is Promptfoo best for?
Promptfoo is best for developers and security teams who need to test LLM apps and agents for prompt injection and data leaks.
Red teaming AI agents and RAG apps
It generates attacks tailored to your app, including prompt injections, jailbreaks, PII leaks and unsafe tool use by agents.
Security checks in CI/CD
Scans run in GitHub, GitLab or Jenkins pipelines and report findings with fix steps inside pull requests.
Comparing prompts and models
You write test cases in YAML and compare outputs across model providers on your own machine, at no cost.
Companies with strict data rules
The On-Premise plan runs on your own infrastructure with full data isolation and a dedicated runner.
How much does Promptfoo cost?
Promptfoo's open-source Community edition is free forever with up to 10,000 red-teaming probes a month, while its Enterprise and On-Premise plans are priced by quote.
- Open source, with all evaluation features, model providers and integrations
- Red teaming up to 10,000 probes a month
- Runs locally or self-hosted, with community support
Enterprise and On-Premise are priced by quote, based on team size and needs. Enterprise adds team sharing, SSO and permission profiles, continuous monitoring, a central security dashboard, API access, a managed cloud deployment and priority support with SLAs. On-Premise adds deployment on your own infrastructure with full data isolation, a dedicated runner and an assigned deployment engineer. A probe is one request sent to your system during a red-team run, and Enterprise customers can buy more. Full pricing on promptfoo.dev. We checked these prices on .
How do readers rate Promptfoo?
No one has rated Promptfoo yet. Be the first.
Sign in to rate. One rating per account.
Is Promptfoo open source?
Yes. Promptfoo's code is public under the MIT licence, so you can read it, change it and run it yourself.
On GitHub
27,148stars
- Last commit
- 14 Nov
- Repository age
- 3 years
- Latest release
- 25 Oct
- Licence
- MIT
- Self-hosted
- No
- Repository
- promptfoo/promptfoo
What are the best Promptfoo alternatives?
Promptfoo is an open source alternative to Adversa AI, DeepKeep, Mindgard and Superagent.
Questions about Promptfoo
What is Promptfoo?
Red teaming and vulnerability tests in your CI/CD.
Who is Promptfoo for?
Promptfoo is best for developers and security teams who need to test LLM apps and agents for prompt injection and data leaks.
Is Promptfoo free?
Yes. Promptfoo's Community edition is open source and free forever, with every evaluation feature and up to 10,000 red-teaming probes a month. You only pay for Enterprise or On-Premise, which add team features, monitoring and support at a quoted price.
Is Promptfoo open source?
Yes. Promptfoo's code is public under the MIT licence, so you can read it, change it and run it yourself.
What are the best Promptfoo alternatives?
The closest alternatives on Recaply are Adversa AI, DeepKeep, Mindgard and Superagent.
Where can I try Promptfoo?
On its official website, promptfoo.dev.
Is Promptfoo part of OpenAI?
Yes. Promptfoo's own About page says the company is now part of OpenAI and that Promptfoo remains open source. The Community, Enterprise and On-Premise plans are still offered under the Promptfoo name on promptfoo.dev.
Testsigma
Autosana
OpenAI Daybreak
KaneAI
Momentic
Spur