Promptfoo
Promptfoo is an open-source tool designed to ensure the security and reliability of LLM (Large Language Models) applications. It offers a comprehensive vulnerability scanner specifically tailored to each LLM product, providing customized probes for detecting PII leaks, unauthorized prompt manipulations, and other critical failures. With capabilities like caching, concurrency, and detailed vulnerability reports, Promptfoo allows developers to build, test, and refine LLM applications efficiently with test-driven development rather than trial-and-error.
Features
- Open-source
- Customized vulnerability probes
- Detection of PII leaks
- Protection against unauthorized prompt manipulations
- Prevention of jailbreaks
- Detailed vulnerability reports
- Support for multiple LLM API providers
- Local operation without cloud dependencies
Use Cases
- Developers of LLM applications
- Security Analysts
- Open-Source Contributors
- Large Organizations
- Tech Startups
- Educators
- QA Engineers
- AI Researchers
