Home / Skills / huggingface-community-evals
huggingface-community-evals
huggingface/skillsSkill
Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.
Why this score
This repo hosts 10 skills, so its 11,187 stars are split between them (about 1,119 each) for scoring.
Popularity score: 79/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank
Security
Scanned Oct 20, 2026 at commit c3ff942be3e0, with Cisco's open-source skill-scanner.
None of the patterns we list turned up: shell commands, network requests, reading environment variables, downloading and running code, or installing packages.
A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan
Alternatives
Other makers' add-ons that do the same job, next to this one.
| Name | Score | Stars | Context | Updated |
|---|---|---|---|---|
| This onehuggingface-community-evals huggingface/skills · Skill | 79 | ★ 11k | ≈81 always | 27d ago |
| huggingface robium-ai/robium · Skill Both about huggingface and hugging | 53 | ★ 96 | ≈23 always | 28d ago |
| huggingface-accelerate OpenRaiser/NanoResearch · Skill Both about huggingface and accelerate | 70 | ★ 1.3k | ≈74 always | 26d ago |
| automationbench-eval bionic-gpt/bionic-gpt · Skill Same job: ai engineering | 73 | ★ 2.4k | ≈31 always | 28d ago |
| eval-audit ai-evals-course/evals-skills · Skill Same job: ai engineering | 66 | ★ 1.5k | ≈21 always | 1mo ago |
| eval-code Calibre-Labs/reforge-ai-evals · Skill Same job: ai engineering | 54 | ★ 76 | ≈26 always | 16d ago |