Promptfoo

Promptfoo is a security testing platform built specifically for AI applications. It helps developers and security teams automatically find and fix vulnerabilities in AI agents, RAG systems, and other LLM-powered workflows. The tool simulates real-world attacks to uncover issues like prompt injections, data leaks, jailbreaks, and insecure tool use, providing a way to test AI applications much like traditional software gets tested for security flaws.

It works by integrating directly into development workflows, connecting to CI/CD pipelines, version control systems, and agent frameworks. Promptfoo generates thousands of context-aware attacks tailored to a specific application's business logic and guardrails. What sets it apart is its focus on remediation; it doesn't just find problems but gives actionable fixes within developer tools like pull requests. The platform is built on threat intelligence from a large community of users, which helps it stay current with new attack vectors.

This tool is most valuable for teams building and deploying AI applications at scale, particularly in regulated industries. Enterprise developers use it to ship more secure agents, while security leaders use it to establish automated, scalable testing processes. Companies like OpenAI and Anthropic, along with 156 Fortune 500 firms, use Promptfoo to build confidence in their AI systems before they reach users.