# promptfoo
標記為「promptfoo」的 37 篇文章
Capstone: Continuous Testing with Promptfoo
Implementing continuous AI security testing using Promptfoo integrated into CI/CD pipelines for automated regression testing and safety validation.
promptfoo for Red Teaming
Deep dive into promptfoo for AI red teaming: YAML configuration, assertion-based testing, red team plugins, custom evaluators, and regression testing workflows for LLM security.
Promptfoo Red Team Test Suite Development
Build comprehensive red team test suites in Promptfoo with custom graders and multi-model targeting.
Setting Up Promptfoo for LLM Evaluation
Configure Promptfoo to create automated test suites for evaluating LLM safety and robustness.
Lab: Promptfoo Setup and First Eval
Install and configure promptfoo for systematic LLM evaluation, then run your first red team evaluation to test model safety boundaries.
Lab: Automated Red Team Pipeline
Hands-on lab for building a continuous AI red team testing pipeline using promptfoo, GitHub Actions, and automated attack generation to catch safety regressions before deployment.
Lab: Automated Red Team Testing
Set up promptfoo for continuous automated security testing of AI applications, with custom evaluators and CI/CD integration.
Lab: Regression Testing with promptfoo
Hands-on lab for setting up promptfoo to run automated regression tests against LLM applications, ensuring that safety properties hold across model updates and prompt changes.
Promptfoo Configuration Guide
Detailed guide to configuring Promptfoo for LLM security testing including provider setup, test assertions, and CI/CD integration.
Red Team Tool Comparison Matrix
Side-by-side comparison of AI red teaming tools -- Garak, PyRIT, promptfoo, Inspect AI, and HarmBench -- covering capabilities, use cases, and integration options.
Red Team Tool Comparison
Comparison of major AI red teaming tools -- Garak, PyRIT, promptfoo, and Inspect AI -- covering capabilities, strengths, limitations, and use cases.
Tool Walkthroughs
End-to-end practical walkthroughs for essential AI red teaming tools, covering installation, configuration, execution, and result interpretation.
Promptfoo CI/CD Pipeline Integration
Integrate Promptfoo into CI/CD pipelines for continuous LLM security regression testing.
Running Your First Promptfoo Evaluation
Beginner walkthrough for running your first promptfoo evaluation from scratch, covering installation, configuration, test case creation, assertion writing, and result interpretation.
Automating Red Team Evaluations with Promptfoo
Complete walkthrough for setting up automated red team evaluation pipelines using Promptfoo, covering configuration, custom evaluators, adversarial dataset generation, CI integration, and result analysis.
Promptfoo for Red Team Evaluation
Configure Promptfoo for comprehensive red team evaluation with custom assertions and graders.
Promptfoo End-to-End Walkthrough
Complete walkthrough of promptfoo for AI red teaming: configuration files, provider setup, running evaluations, red team plugins, assertion-based scoring, reporting, and CI/CD integration.
Promptfoo CI/CD Pipeline Integration (Tool Walkthrough)
Integrate Promptfoo red team evaluations into CI/CD pipelines for automated security regression testing.
章節評量：工具熟練度
15 題校準評量，測試你對 AI 紅隊演練工具生態系的理解——Garak、PyRIT、Promptfoo 與自訂自動化。
Capstone: Continuous Testing with Promptfoo
Implementing continuous AI security testing using Promptfoo integrated into CI/CD pipelines for automated regression testing and safety validation.
promptfoo 用於紅隊
promptfoo 用於 AI 紅隊的深入解析：YAML 組態、以斷言為基礎的測試、紅隊外掛、自製評估器，以及 LLM 安全的回歸測試流程。
Promptfoo 紅隊 Test Suite Development
Build comprehensive red team test suites in Promptfoo with custom graders and multi-model targeting.
Setting Up Promptfoo for LLM Evaluation
Configure Promptfoo to create automated test suites for evaluating LLM safety and robustness.
實驗室: Promptfoo Setup and First Eval
Install and configure promptfoo for systematic LLM evaluation, then run your first red team evaluation to test model safety boundaries.
實驗室: Automated 紅隊 Pipeline
Hands-on lab for building a continuous AI red team testing pipeline using promptfoo, GitHub Actions, and automated attack generation to catch safety regressions before deployment.
實驗室: Automated 紅隊 Testing
Set up promptfoo for continuous automated security testing of AI applications, with custom evaluators and CI/CD integration.
實作：以 promptfoo 進行回歸測試
設置 promptfoo 以對 LLM 應用執行自動化回歸測試之實作，確保安全屬性於模型更新與提示變更間保持。
Promptfoo Configuration 指南
Detailed guide to configuring Promptfoo for LLM security testing including provider setup, test assertions, and CI/CD integration.
紅隊工具比較矩陣
AI 紅隊工具的並列比較——Garak、PyRIT、promptfoo、Inspect AI 與 HarmBench——涵蓋能力、使用案例與整合選項。
紅隊工具比較
主要 AI 紅隊工具的比較——Garak、PyRIT、promptfoo 與 Inspect AI——涵蓋能力、強項、侷限與用途。
工具導覽
必備 AI 紅隊演練工具的端對端實務導覽，涵蓋安裝、設定、執行與結果詮釋。
Promptfoo CI/CD Pipeline Integration
Integrate Promptfoo into CI/CD pipelines for continuous LLM security regression testing.
Running Your First Promptfoo Evaluation
初階 walkthrough for running your first promptfoo evaluation from scratch, covering installation, configuration, test case creation, assertion writing, and result interpretation.
Automating 紅隊 Evaluations with Promptfoo
Complete walkthrough for setting up automated red team evaluation pipelines using Promptfoo, covering configuration, custom evaluators, adversarial dataset generation, CI integration, and result analysis.
Promptfoo for 紅隊 Evaluation
Configure Promptfoo for comprehensive red team evaluation with custom assertions and graders.
Promptfoo End-to-End 導覽
Complete walkthrough of promptfoo for AI red teaming: configuration files, provider setup, running evaluations, red team plugins, assertion-based scoring, reporting, and CI/CD integration.
Promptfoo CI/CD Pipeline Integration (工具 導覽)
Integrate Promptfoo red team evaluations into CI/CD pipelines for automated security regression testing.