Home / Plugins / promptfoo-evals
promptfoo-evals
promptfoo/promptfooPlugin
Teaches AI coding agents to create and maintain promptfoo eval suites. Encodes best practices like deterministic assertions first, file-based test organization, correct environment variable syntax, and proper hallucination/faithfulness checks. Includes a cheatsheet covering 30+ assertion types, provider patterns for OpenAI/Anthropic/Google/Bedrock/HTTP/Python/JS, and test patterns for JSON validation, dataset-driven scaling, and CI-friendly runs.
Why this score
Popularity score: 96/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank
Security
Scanned Oct 22, 2026 at commit 253bd92a44f5, with Cisco's open-source skill-scanner.
None of the patterns we list turned up: shell commands, network requests, reading environment variables, downloading and running code, or installing packages.
A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan
Alternatives
Other makers' add-ons that do the same job, next to this one.
| Name | Score | Stars | Context | Updated |
|---|---|---|---|---|
| This onepromptfoo-evals promptfoo/promptfoo · Plugin | 96 | ★ 27k | not measured | today |
| eval-code Calibre-Labs/reforge-ai-evals · Skill Same job: ai engineering | 54 | ★ 76 | ≈26 always | 16d ago |
| eval-audit ai-evals-course/evals-skills · Skill Same job: ai engineering | 66 | ★ 1.5k | ≈21 always | 1mo ago |
| automationbench-eval bionic-gpt/bionic-gpt · Skill Same job: ai engineering | 73 | ★ 2.4k | ≈31 always | 28d ago |
| harness-eval HKUDS/OpenHarness · Skill Same job: ai engineering | 80 | ★ 16k | ≈74 always | 5mo ago |
| agentic-eval sandbaseai/sandbase-skills · Skill Same job: ai engineering | 52 | ★ 202 | ≈49 always | 1mo ago |