Home / Skills / vss-evaluate-caption-accuracy
vss-evaluate-caption-accuracy
NVIDIA-AI-Blueprints/video-search-and-summarizationSkill
Measure whether an RT-VLM configuration change altered caption quality — capture paired baseline and candidate captions for a set of videos, score both against a ground truth with an LLM judge, and emit an accuracy and processing-time table. Use when changing frame selection, decode, or model settings and you need evidence there is no accuracy regression.
Why this score
This repo hosts 10 skills, so its 1,933 stars are split between them (about 193 each) for scoring.
Popularity score: 73/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank
Security
Scanned Oct 21, 2026 at commit d06f1a619d0a, with Cisco's open-source skill-scanner.
What its code does:
- Runs shell commands Common for dev tools. Read the commands it runs.scripts/run_captioning.py:421, scripts/run_eval.sh:79 and 4 more
- Makes network requestsSKILL.md, scripts/multi_judge.py:378, scripts/run_captioning.py:525 and 5 more
- Reads environment variables, where API keys usually livescripts/run_captioning.py:483
Web addresses in its code:
- api.anthropic.comscripts/multi_judge.py:490
- api.openai.comscripts/multi_judge.py:426
These are the sites named in the code, so it's where your data could go. It isn't a complete list: code can build addresses while it runs, and a few of these may be links rather than calls. Whatever you send also goes to the AI model you use.
A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan
Alternatives
Other makers' add-ons that do the same job, next to this one.
| Name | Score | Stars | Context | Updated |
|---|---|---|---|---|
| This onevss-evaluate-caption-accuracy NVIDIA-AI-Blueprints/video-search-and-summarization · Skill | 73 | ★ 1.9k | ≈97 always | 16d ago |
| evaluate-skill every-app/open-seo · Skill Same job: recruiting & job search | 85 | ★ 24k | ≈81 always | 16d ago |
| evaluate-cluster stas00/ml-engineering · Skill Both about evaluate | 88 | ★ 20k | ≈24 always | 19d ago |
| debugging-litert-gpu-accuracy google-ai-edge/LiteRT · Skill Both about accuracy | 80 | ★ 3.5k | ≈26 always | 16d ago |
| captions ZeroPointRepo/youtube-skills · Skill Both about caption and video | 65 | ★ 1.1k | ≈96 always | 21d ago |
| evaluate-rag ai-evals-course/evals-skills · Skill Both about evaluate and quality | 66 | ★ 1.5k | ≈20 always | 1mo ago |