Home / Skills / vss-benchmark-vlm-qa
vss-benchmark-vlm-qa
NVIDIA-AI-Blueprints/video-search-and-summarizationSkill
Benchmark video Q&A accuracy and latency of a deployed RT-VLM (Cosmos Reason 3) via vss vlm run, using questions and videos from the DSS vss-devx-base dataset. Replaces the deprecated nat eval / vss-agent QA path. Not for tool-calling or trajectory evaluation, and not for LVS summarization throughput.
Why this score
This repo hosts 10 skills, so its 1,933 stars are split between them (about 193 each) for scoring.
Popularity score: 73/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank
Security
Scanned Oct 21, 2026 at commit d06f1a619d0a, with Cisco's open-source skill-scanner.
What its code does:
- Makes network requestsSKILL.md, scripts/benchmark_vlm_qa.py:490 and 1 more
Web addresses in its code:
- org.ngc.nvidia.comscripts/benchmark_vlm_qa.py:832
These are the sites named in the code, so it's where your data could go. It isn't a complete list: code can build addresses while it runs, and a few of these may be links rather than calls. Whatever you send also goes to the AI model you use.
A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan
Alternatives
Other makers' add-ons that do the same job, next to this one.
| Name | Score | Stars | Context | Updated |
|---|---|---|---|---|
| This onevss-benchmark-vlm-qa NVIDIA-AI-Blueprints/video-search-and-summarization · Skill | 73 | ★ 1.9k | ≈81 always | 16d ago |
| benchmark garrytan/gstack · Skill Both about benchmark | 93 | ★ 137k | ≈14 always | 16d ago |
| add-benchmark allenai/vla-evaluation-harness · Skill Same job: ai engineering | 72 | ★ 650 | ≈37 always | 20d ago |
| ai-qa-review petrkindlmann/qa-skills · Skill Both about qa | 52 | ★ 195 | ≈23 always | 5mo ago |
| benchmark-analyst growthack88/growth-marketing-os · Skill Both about benchmark | 60 | ★ 122 | ≈22 always | 25d ago |
| qa-bach MaxMiksa/Autonomous-Company · Subagent Both about qa | 69 | ★ 3.1k | ≈17 in chat | 18d ago |