Home / Skills / launching-evals
launching-evals
Run, monitor, analyze, and debug LLM evaluations via nemo-evaluator-launcher. Covers running evaluations, checking status and live progress, debugging failed runs, exporting artifacts and logs, and analyzing results. ALWAYS triggers on mentions of running evaluations, checking progress, debugging failed evals, analyzing or analysing runs or results, run directories or artifact paths on clusters, Slurm job issues, invocation IDs, or inspecting logs (client logs, server logs, SSH to cluster, tail logs, grep logs). Do NOT use for creating or modifying evaluation configs.
Why this score
This repo hosts 10 skills, so its 5,374 stars are split between them (about 537 each) for scoring.
Popularity score: 77/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank
Security
Scanned Oct 21, 2026 at commit f1d68fd4dd50, with Cisco's open-source skill-scanner.
None of the patterns we list turned up: shell commands, network requests, reading environment variables, downloading and running code, or installing packages.
A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan
Alternatives
Other makers' add-ons that do the same job, next to this one.
| Name | Score | Stars | Context | Updated |
|---|---|---|---|---|
| This onelaunching-evals NVIDIA/Model-Optimizer · Skill | 77 | ★ 5.4k | ≈148 always | 16d ago |
| eval-code Calibre-Labs/reforge-ai-evals · Skill Same job: ai engineering | 54 | ★ 76 | ≈26 always | 16d ago |
| write-code-eval ai-evals-course/evals-skills · Skill Same job: ai engineering | 66 | ★ 1.5k | ≈23 always | 1mo ago |
| automationbench-eval bionic-gpt/bionic-gpt · Skill Same job: ai engineering | 73 | ★ 2.4k | ≈31 always | 28d ago |
| harness-eval HKUDS/OpenHarness · Skill Same job: ai engineering | 80 | ★ 16k | ≈74 always | 5mo ago |
| investigating-eval-results GoogleChrome/modern-web-guidance-src · Skill Same job: ai engineering | 69 | ★ 1.2k | ≈29 always | 16d ago |