Home / Skills / agent-evaluation
agent-evaluation
为 Agent 建立或改进评估体系时使用——设计评估指标（Pass@k/Pass^k/成本）、搭建可重复运行的评估环境、选择确定性验证器或 LLM-as-a-Judge 及各自适用边界、编写 Rubric、做失败归因与回归任务、评估驱动的模型选型、判断统计显著性、建设可观测性与内部评估基础设施（消融、AB 测试、特性开关、提示词回归）、从 Benchmark 报告走到系统改进。
Why this score
This repo hosts 10 skills, so its 54,962 stars are split between them (about 5,496 each) for scoring.
Popularity score: 88/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank
Security
Scanned Oct 20, 2026 at commit dbc046eb896a, with Cisco's open-source skill-scanner.
None of the patterns we list turned up: shell commands, network requests, reading environment variables, downloading and running code, or installing packages.
A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan
Alternatives
Other makers' add-ons that do the same job, next to this one.
| Name | Score | Stars | Context | Updated |
|---|---|---|---|---|
| This oneagent-evaluation bojieli/ai-agent-book · Skill | 88 | ★ 55k | ≈52 always | 27d ago |
| agent-evaluation-operations TheGoat395/Codex-Skills · Skill Both about evaluation | 52 | ★ 129 | ≈18 always | 2mo ago |
| run-evaluation allenai/vla-evaluation-harness · Skill Both about evaluation | 72 | ★ 650 | ≈34 always | 20d ago |
| advanced-evaluation muratcankoylan/Agent-Skills-for-Context-Engineering · Skill Both about evaluation and rubric | 82 | ★ 18k | ≈59 always | 24d ago |
| agent-self-evaluation affaan-m/ECC · Skill Both about evaluation | 96 | ★ 284k | ≈71 always | 16d ago |
| analyzing-offline-evaluations PostHog/ai-plugin · Skill Both about evaluation | 49 | ★ 93 | ≈26 always | 16d ago |