Principle:Promptfoo Promptfoo CI Notification

Knowledge Sources	Promptfoo GitHub Action
Domains	CI_CD, Reporting
Last Updated	2026-02-14 08:00 GMT

Overview

An automated notification mechanism that posts evaluation and security scan results as comments on pull requests.

Description

CI Notification integrates evaluation results into the developer workflow by posting findings directly on pull requests. The Promptfoo Code Scan GitHub Action analyzes PR diffs for security issues and posts findings as PR comments with severity ratings, while the general-purpose GitHub Action runs full evaluations and reports results.

Usage

Use this principle when you want evaluation or security scan results to appear directly on PRs. Configure the GitHub Action in your workflow YAML.

Theoretical Basis

Pseudo-code Logic:

1. Trigger on PR event (opened, synchronized)
2. Analyze PR diff for security-relevant code changes
3. Run evaluation/scan against configured targets
4. Format results as GitHub PR comment
5. Post comment using GitHub API (github-token)
6. Set check status based on severity threshold

Related Pages

Implemented By

Implementation:Promptfoo_Promptfoo_GitHub_Action

Page Connections

Double-click a node to navigate. Hold to expand connections.

Principle

Implementation

Heuristic

Environment