About
What is Promptfoo?
Promptfoo is an AI security platform designed to help developers and organizations build secure AI applications by proactively identifying and fixing vulnerabilities. It integrates into the development workflow, offering automated red teaming to simulate real users and uncover application-specific vulnerabilities like prompt injections, jailbreaks, and data leaks. The platform also provides guardrails for real-time protection, comprehensive model security testing, and code scanning for LLM vulnerabilities in IDEs and CI/CD pipelines. With features like evaluations for prompts, models, and RAG pipelines, Promptfoo ensures AI security from integration to remediation, providing actionable guidance directly in pull requests. It is trusted by a large community and enterprises, offering solutions for CISOs, Security Directors, and Developers.
Best used for
Ideal for developers and security teams who need to proactively identify and fix vulnerabilities in their AI applications, test prompts and models, and ensure real-time protection against attacks. Especially valuable for integrating AI security testing directly into the development workflow and CI/CD pipelines.
Common actions
pii leaksSecurityprompt manipulationLLMreliabilityopen-sourcevulnerability scannervulnerability reports
Capabilities
Key features
- Automated red teaming
- Real-time guardrails
- Model security testing
- Code scanning
- Prompt/RAG evaluations
- Remediation guidance
- Continuous monitoring
Integrations
githubgitlabjenkins
Pricing & Plans
Freemium · Enterprise · Open Source
Not publicly disclosed. Check promptfoo.dev for current pricing.
FAQs
What is included in the Promptfoo Community version?
The Community version is a free, open-source tool that includes all core features for local testing, evaluation, and basic vulnerability scanning. It supports all LLM evaluation features, model providers, and integrations, along with red teaming up to 10k probes per month.
What is a 'probe' in Promptfoo's red teaming?
A probe refers to a single request made to your target system during red team testing. Certain red teaming plugins use inference for dynamic test generation and grading, and the Community version includes up to 10,000 probes per month at no charge.
Who is the Promptfoo Enterprise version designed for?
The Enterprise version is for larger teams and organizations that require advanced features like continuous monitoring, custom red teaming limits, team collaboration, centralized security dashboards, SSO, and granular permissions. It also includes priority support and SLA guarantees.
Shypd.aiThe largest open index of AI tools
