Home / Skills / bat-story-eval

bat-story-eval

homeassistant-ai/ha-mcpSkill

Compare MCP tool behavior between target and baseline versions using pre-built and custom stories with diff-based triage.

ScannedSkillSource: GitHub
5,141 stars +98 this week Updated 16d ago License MIT Context ≈34 tokens always loaded
76popular

Why this score

Stars20/35
Usage (forks)6/15
Upkeep25/25
License15/15
Owner history10/10

This repo hosts 8 skills, so its 5,141 stars are split between them (about 643 each) for scoring.

Popularity score: 76/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank

Security

Scanned Oct 20, 2026 at commit 3316943739e8, with Cisco's open-source skill-scanner.

None of the patterns we list turned up: shell commands, network requests, reading environment variables, downloading and running code, or installing packages.

A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan

Alternatives

Other makers' add-ons that do the same job, next to this one.

NameScoreStarsContextUpdated
This onebat-story-eval homeassistant-ai/ha-mcp · Skill 76★ 5.1k≈34 always16d ago
eval-audit ai-evals-course/evals-skills · Skill Same job: ai engineering 66★ 1.5k≈21 always1mo ago
eval-code Calibre-Labs/reforge-ai-evals · Skill Same job: ai engineering 54★ 76≈26 always16d ago
automationbench-eval bionic-gpt/bionic-gpt · Skill Same job: ai engineering 73★ 2.4k≈31 always28d ago
harness-eval HKUDS/OpenHarness · Skill Same job: ai engineering 80★ 16k≈74 always5mo ago
agentic-eval sandbaseai/sandbase-skills · Skill Same job: ai engineering 52★ 202≈49 always1mo ago