# promptfoo
18 articlestagged with “promptfoo”
Capstone: Continuous Testing with Promptfoo
Implementing continuous AI security testing using Promptfoo integrated into CI/CD pipelines for automated regression testing and safety validation.
promptfoo for Red Teaming
Deep dive into promptfoo for AI red teaming: YAML configuration, assertion-based testing, red team plugins, custom evaluators, and regression testing workflows for LLM security.
Promptfoo Red Team Test Suite Development
Build comprehensive red team test suites in Promptfoo with custom graders and multi-model targeting.
Setting Up Promptfoo for LLM Evaluation
Configure Promptfoo to create automated test suites for evaluating LLM safety and robustness.
Lab: Promptfoo Setup and First Eval
Install and configure promptfoo for systematic LLM evaluation, then run your first red team evaluation to test model safety boundaries.
Lab: Automated Red Team Pipeline
Hands-on lab for building a continuous AI red team testing pipeline using promptfoo, GitHub Actions, and automated attack generation to catch safety regressions before deployment.
Lab: Automated Red Team Testing
Set up promptfoo for continuous automated security testing of AI applications, with custom evaluators and CI/CD integration.
Lab: Regression Testing with promptfoo
Hands-on lab for setting up promptfoo to run automated regression tests against LLM applications, ensuring that safety properties hold across model updates and prompt changes.
Promptfoo Configuration Guide
Detailed guide to configuring Promptfoo for LLM security testing including provider setup, test assertions, and CI/CD integration.
Red Team Tool Comparison Matrix
Side-by-side comparison of AI red teaming tools -- Garak, PyRIT, promptfoo, Inspect AI, and HarmBench -- covering capabilities, use cases, and integration options.
Red Team Tool Comparison
Comparison of major AI red teaming tools -- Garak, PyRIT, promptfoo, and Inspect AI -- covering capabilities, strengths, limitations, and use cases.
Tool Walkthroughs
End-to-end practical walkthroughs for essential AI red teaming tools, covering installation, configuration, execution, and result interpretation.
Promptfoo CI/CD Pipeline Integration
Integrate Promptfoo into CI/CD pipelines for continuous LLM security regression testing.
Running Your First Promptfoo Evaluation
Beginner walkthrough for running your first promptfoo evaluation from scratch, covering installation, configuration, test case creation, assertion writing, and result interpretation.
Automating Red Team Evaluations with Promptfoo
Complete walkthrough for setting up automated red team evaluation pipelines using Promptfoo, covering configuration, custom evaluators, adversarial dataset generation, CI integration, and result analysis.
Promptfoo for Red Team Evaluation
Configure Promptfoo for comprehensive red team evaluation with custom assertions and graders.
Promptfoo End-to-End Walkthrough
Complete walkthrough of promptfoo for AI red teaming: configuration files, provider setup, running evaluations, red team plugins, assertion-based scoring, reporting, and CI/CD integration.
Promptfoo CI/CD Pipeline Integration (Tool Walkthrough)
Integrate Promptfoo red team evaluations into CI/CD pipelines for automated security regression testing.