Principle:Promptfoo Promptfoo CI Notification
| Knowledge Sources | |
|---|---|
| Domains | CI_CD, Reporting |
| Last Updated | 2026-02-14 08:00 GMT |
Overview
An automated notification mechanism that posts evaluation and security scan results as comments on pull requests.
Description
CI Notification integrates evaluation results into the developer workflow by posting findings directly on pull requests. The Promptfoo Code Scan GitHub Action analyzes PR diffs for security issues and posts findings as PR comments with severity ratings, while the general-purpose GitHub Action runs full evaluations and reports results.
Usage
Use this principle when you want evaluation or security scan results to appear directly on PRs. Configure the GitHub Action in your workflow YAML.
Theoretical Basis
Pseudo-code Logic:
1. Trigger on PR event (opened, synchronized)
2. Analyze PR diff for security-relevant code changes
3. Run evaluation/scan against configured targets
4. Format results as GitHub PR comment
5. Post comment using GitHub API (github-token)
6. Set check status based on severity threshold
Related Pages
Implemented By
Page Connections
Double-click a node to navigate. Hold to expand connections.
Principle
Implementation
Heuristic
Environment