agent-eval
Use when measuring whether an LLM or agent system actually got better and gating merges on it: golden sets, fixing an inflated LLM-as-judge, scoring RAG (faithfulness, contextual recall) or agent trajectories (tool correctness, completion), or picking an eval framework. NOT building the agent loop, tools or RAG plumbing (that is `building-agents`).
Why this score
This repo hosts 10 skills, so its 230 stars are split between them (about 23 each) for scoring.
Popularity score: 62/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank
Security
Scanned Oct 20, 2026 at commit f5ac957c271b, with Cisco's open-source skill-scanner.
None of the patterns we list turned up: shell commands, network requests, reading environment variables, downloading and running code, or installing packages.
A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan
Alternatives
Other makers' add-ons that do the same job, next to this one.
| Name | Score | Stars | Context | Updated |
|---|---|---|---|---|
| This oneagent-eval ericrisco/rsc-harness · Skill | 62 | ★ 230 | ≈90 always | 16d ago |
| agent-eval-canvas GCWing/OpenBitFun · Skill Same job: ai engineering | 73 | ★ 2.9k | ≈23 always | 16d ago |
| agent-evals-and-observability magnus919/agent-skills · Skill Same job: ai engineering | 60 | ★ 137 | ≈27 always | 16d ago |
| braintrust-agent-evals githits-com/githits-cli · Skill Same job: ai engineering | 61 | ★ 115 | ≈38 always | 16d ago |
| eval-audit ai-evals-course/evals-skills · Skill Same job: ai engineering | 66 | ★ 1.5k | ≈21 always | 1mo ago |
| eval-llm-judge Calibre-Labs/reforge-ai-evals · Skill Same job: ai engineering | 54 | ★ 76 | ≈26 always | 16d ago |