Home / Skills / dspy-evaluation-suite
dspy-evaluation-suite
Use for evaluating DSPy programs with Evaluate, answer_exact_match, SemanticF1, custom metrics, baselines, and program comparisons.
Why this score
This repo hosts 10 skills, so its 124 stars are split between them (about 12 each) for scoring.
Popularity score: 50/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank
Security
Scanned Oct 20, 2026 at commit f5db3b7b1fe3, with Cisco's open-source skill-scanner.
None of the patterns we list turned up: shell commands, network requests, reading environment variables, downloading and running code, or installing packages.
A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan
Alternatives
Other makers' add-ons that do the same job, next to this one.
| Name | Score | Stars | Context | Updated |
|---|---|---|---|---|
| This onedspy-evaluation-suite OmidZamani/dspy-skills · Skill | 50 | ★ 124 | ≈38 always | 4mo ago |
| evaluation muratcankoylan/Agent-Skills-for-Context-Engineering · Skill Both about evaluation and suite | 82 | ★ 18k | ≈62 always | 24d ago |
| run-evaluation allenai/vla-evaluation-harness · Skill Both about evaluation | 72 | ★ 650 | ≈34 always | 20d ago |
| AvianSuite kyle-visner/stellarjay · MCP server Both about suite | 52 | ★ 9 | not measured | 5d ago |
| lark-suite larksuite/cli · Skill Both about suite | 82 | ★ 18k | ≈33 always | 16d ago |
| experiment-suite ai4s-research/ai4s-skills · Skill Both about suite | 50 | ★ 245 | ≈67 always | 3mo ago |