promptfoo

promptfoo is an open source command-line tool and library for evaluating and red teaming applications built on large language models (LLMs). Test cases, prompts and providers are declared in a configuration file, and promptfoo runs them and scores the outputs automatically with assertions and metrics, including model-graded checks.

Evaluations compare prompts, models and RAG pipelines side by side, with caching, concurrency and live reloading to speed up iterations. The red teaming mode generates attacks to scan applications and agents for security vulnerabilities and compliance risks, such as prompt injection or data leakage, and produces a vulnerability report. promptfoo works with OpenAI, Anthropic, Azure, Google, Hugging Face, open-source models and custom API providers, and runs in CI/CD pipelines.

promptfoo is open source under the MIT licence. A commercial enterprise version adds features for teams.