Promptfoo

What does Promptfoo do?

Promptfoo automates AI security testing by generating application-specific attacks, running evaluations, and turning findings into remediation guidance. Its red teaming flow simulates real users to uncover prompt injections, jailbreaks, data leaks, tool misuse, and other risks, while guardrails add a feedback loop that improves defenses over time. Code scanning brings the same checks into IDE and CI/CD workflows, so teams can catch issues before they ship. At scale, Promptfoo is used by 156 of the Fortune 500 and backed by a 300k+ user community with 300,000+ developers contributing threat intelligence and test ideas. The platform covers 50+ vulnerability types and supports local or self-hosted deployment for teams that want control over their environment. Customers and users cited on the site include OpenAI, Anthropic, Shopify, Discord, Okta, and Fidelity, alongside enterprise teams that need continuous monitoring and compliance reporting.

Why use Promptfoo?

• It combines red teaming, guardrails, model security, and code scanning in one workflow, so teams can move from finding issues to fixing them faster.
• The open-source Community tier supports local use and self-hosting, which helps teams keep testing close to their own infrastructure.
• Continuous monitoring and remediation guidance reduce the gap between a vulnerability report and an actual fix.
• Its adaptive guardrails use red team findings to refine defenses, so protection can improve as attack patterns change.
• The platform is built for enterprise adoption, with SSO, granular permissions, and centralized security dashboards in paid plans.

Who is Promptfoo for?

• Security directors who need enterprise-scale AI risk testing across many applications.
• Developers who want LLM vulnerability checks inside their coding workflow.
• Platform teams who need continuous monitoring and remediation tracking.
• Compliance teams who need audit-ready security reports and framework mapping.
• AI engineering teams who need to test prompts, models, RAG, and agents together.

What are Promptfoo's key features?

What does Promptfoo integrate with?

• GitHub
• GitLab
• Jenkins
• AWS CodeCommit
• Splunk
• Azure Pipelines
• Bitbucket Pipelines
• Burp Suite
• CircleCI
• GitHub Actions
• GitLab CI
• Google Sheets
• Helicone
• Langfuse
• Looper
• n8n
• Portkey AI
• SharePoint
• SonarQube
• Travis CI
• VS Code

What are Promptfoo's use cases?

How does Promptfoo work?

1. Connect your first app, model, or repository through GitHub, GitHub Actions, VS Code, or another supported integration, then point Promptfoo at the prompts, models, RAG, or agents you want to test.
2. Run Red Teaming and Evaluations to probe for jailbreaks, hallucinations, and policy gaps, or use Code Scanning and Pull Request Review to catch issues before they ship.
3. Review findings in Centralized security management, then apply Guardrails or whitelist approved MCP servers to reduce exposure and control what your AI systems can access.
4. Monitor ongoing behavior with Real-time monitoring & alerts and Continuous monitoring, so new regressions surface quickly and teams can respond before users are affected.
5. Use Self-improving protection and Data-driven improvement to tune defenses over time, keeping remediation visible and your AI stack safer as it changes.

How much does Promptfoo cost?

Frequently asked questions