autoeval
AlchemyInCode/plumloom-autoeval-ossSkill
Run Plumloom Autoeval evaluations and release gates for AI agents and LLM features from the terminal. Use when the user asks to evaluate or test an agent, prompt, model or RAG change, run evals or an eval suite, check whether a change is safe to release, gate a release, or read evaluation results, scores or a PASS / FAIL / INCONCLUSIVE verdict. Reports the verdict Autoeval returns and never edits evals or thresholds to change it.
Why this score
Popularity score: 64/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank
Security
Scanned Oct 21, 2026 at commit 5c4eb2375d46, with Cisco's open-source skill-scanner.
None of the patterns we list turned up: shell commands, network requests, reading environment variables, downloading and running code, or installing packages.
A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan
Alternatives
Nothing from another maker does quite the same job yet.