Home / Skills / validate-evaluator
validate-evaluator
ai-evals-course/evals-skillsSkill
Calibrate an LLM judge against human labels using data splits, TPR/TNR, and
Why this score
This repo hosts 9 skills, so its 1,533 stars are split between them (about 170 each) for scoring.
Popularity score: 66/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank
Security
Scanned Oct 21, 2026 at commit 80d5f7b0127c, with Cisco's open-source skill-scanner.
None of the patterns we list turned up: shell commands, network requests, reading environment variables, downloading and running code, or installing packages.
A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan
Alternatives
Other makers' add-ons that do the same job, next to this one.
| Name | Score | Stars | Context | Updated |
|---|---|---|---|---|
| This onevalidate-evaluator ai-evals-course/evals-skills · Skill | 66 | ★ 1.5k | ≈24 always | 1mo ago |
| loop-plan-evaluator Ibrahim-3d/orchestrator-supaconductor · Subagent Both about evaluator and validate | 57 | ★ 380 | ≈25 in chat | 1mo ago |
| skill-evaluator gotalab/skillport · Skill Both about evaluator and against | 59 | ★ 415 | ≈80 always | 4mo ago |
| validate-skills callstackincubator/agent-skills · Skill Both about validate and against | 71 | ★ 1.7k | ≈35 always | 27d ago |
| magpie-kernel-evaluator amd/skills · Skill Both about evaluator and validate | 64 | ★ 423 | ≈142 always | 16d ago |
| heuristic-evaluator code-yeongyu/lazycodex · Subagent Both about evaluator and against | 74 | ★ 3.8k | ≈83 in chat | 16d ago |