Home / Skills / agent-evaluation
agent-evaluation
seb1n/awesome-ai-agent-skillsSkill
Design reproducible evaluations for AI agents with representative task sets, explicit rubrics, appropriate graders, baselines, regression gates, and failure analysis. Use when defining agent quality, comparing prompts or models, validating a release, measuring tool-use reliability, investigating regressions, or deciding whether an agent is ready for production.
Why this score
This repo hosts 10 skills, so its 218 stars are split between them (about 22 each) for scoring.
Popularity score: 58/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank
Security
Scanned Oct 20, 2026 at commit 75865a5d037a, with Cisco's open-source skill-scanner.
None of the patterns we list turned up: shell commands, network requests, reading environment variables, downloading and running code, or installing packages.
A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan
Alternatives
Other makers' add-ons that do the same job, next to this one.
| Name | Score | Stars | Context | Updated |
|---|---|---|---|---|
| This oneagent-evaluation seb1n/awesome-ai-agent-skills · Skill | 58 | ★ 218 | ≈95 always | 3mo ago |
| agent-evaluation-operations TheGoat395/Codex-Skills · Skill Both about evaluation | 52 | ★ 129 | ≈18 always | 2mo ago |
| run-evaluation allenai/vla-evaluation-harness · Skill Both about evaluation | 72 | ★ 650 | ≈34 always | 20d ago |
| advanced-evaluation muratcankoylan/Agent-Skills-for-Context-Engineering · Skill Both about evaluation and rubric | 82 | ★ 18k | ≈59 always | 24d ago |
| nat-evaluation NVIDIA/NeMo-Agent-Toolkit · Skill Both about evaluation and gate | 75 | ★ 2.7k | ≈51 always | 17d ago |
| agent-self-evaluation affaan-m/ECC · Skill Both about evaluation | 96 | ★ 284k | ≈71 always | 16d ago |