ai-evals
Help users build robust infrastructure for measuring, monitoring, and iterating on AI product performance using human, code-based, and LLM-as-a-judge methodologies.
Why this score
This repo hosts 10 skills, so its 1,431 stars are split between them (about 143 each) for scoring.
Popularity score: 57/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank
Security
Scanned Oct 20, 2026 at commit 13598cc54e09, with Cisco's open-source skill-scanner.
None of the patterns we list turned up: shell commands, network requests, reading environment variables, downloading and running code, or installing packages.
A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan
Alternatives
Other makers' add-ons that do the same job, next to this one.
| Name | Score | Stars | Context | Updated |
|---|---|---|---|---|
| This oneai-evals RefoundAI/lenny-skills · Skill | 57 | ★ 1.4k | ≈43 always | 4mo ago |
| ai-eval-engineer avelikiy/great_cto · Subagent Same job: ai engineering | 56 | ★ 103 | ≈77 in chat | 16d ago |
| eval-audit ai-evals-course/evals-skills · Skill Same job: ai engineering | 66 | ★ 1.5k | ≈21 always | 1mo ago |
| eval-llm-judge Calibre-Labs/reforge-ai-evals · Skill Same job: ai engineering | 54 | ★ 76 | ≈26 always | 16d ago |
| automationbench-eval bionic-gpt/bionic-gpt · Skill Same job: ai engineering | 73 | ★ 2.4k | ≈31 always | 28d ago |
| harness-eval HKUDS/OpenHarness · Skill Same job: ai engineering | 80 | ★ 16k | ≈74 always | 5mo ago |