Jump to content

Connect SuperML | Leeroopedia MCP: Equip your AI agents with best practices, code verification, and debugging knowledge. Powered by Leeroo — building Organizational Superintelligence. Contact us at founders@leeroo.com.

Principle:Promptfoo Promptfoo Redteam Report Generation

From Leeroopedia
Knowledge Sources
Domains Security_Testing, Reporting
Last Updated 2026-02-14 08:00 GMT

Overview

A report generation mechanism that outputs synthesized adversarial test cases as reusable YAML configuration files.

Description

Red Team Report Generation serializes the output of the attack generation pipeline into YAML config files that can be re-executed with `promptfoo eval`. This enables a two-phase workflow: generate tests once, then iterate on evaluation without regenerating.

The generated config includes the full evaluation specification: target provider, generated test cases with assertions, and metadata about purpose, entities, and plugin sources.

Usage

Use this principle when saving generated red team tests for later execution or review. This is the output of `promptfoo redteam generate` and the intermediate step in `promptfoo redteam run`.

Theoretical Basis

Pseudo-code Logic:

1. Call synthesize() to generate test cases
2. Calculate test count breakdown for reporting
3. Format generated tests as UnifiedConfig YAML structure
4. Write to output path (or return programmatically)
5. Config is ready for execution via `promptfoo eval`

Related Pages

Implemented By

Page Connections

Double-click a node to navigate. Hold to expand connections.
Principle
Implementation
Heuristic
Environment