Home / Skills / baseline-comparison-audit
baseline-comparison-audit
wanshuiyin/Anti-AutoresearchSkill
Audit whether a paper's baseline comparisons are COMPLETE, FAIR, and SIGNIFICANT: a required recent SOTA baseline is missing while 'best/SOTA' is claimed (HP-MISSING-BASELINE); a baseline is undertuned / given less compute-tuning-data, run at a mismatched config, or the equal-budget ablation-as-baseline is absent (HP-WEAK-BASELINE); 'outperforms' is asserted over overlapping error bars or with no variance/seeds (HP-SIG-OVERLAP); and a cross-row 'improves over baseline by X%' is arithmetically wrong (HP-DELTA-ERROR, cross-row form only). A versioned per-domain baseline profile + a live leaderbo
Why this score
This repo hosts 10 skills, so its 165 stars are split between them (about 17 each) for scoring.
Popularity score: 60/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank
Security
Scanned Oct 20, 2026 at commit 5f5d82421c75, with Cisco's open-source skill-scanner.
What its code does:
- Runs shell commands Common for dev tools. Read the commands it runs.SKILL.md:834
A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan
Alternatives
Other makers' add-ons that do the same job, next to this one.
| Name | Score | Stars | Context | Updated |
|---|---|---|---|---|
| This onebaseline-comparison-audit wanshuiyin/Anti-Autoresearch · Skill | 60 | ★ 165 | ≈157 always | 18d ago |
| analyze-comparison-tests microsoft/GitHub-Copilot-for-Azure · Skill Both about comparison | 56 | ★ 259 | ≈46 always | 16d ago |
| baseline-ui ibelick/ui-skills · Skill Both about baseline | 80 | ★ 9.9k | ≈40 always | 18d ago |
| speckit-baseline dceoy/speckit-agent-skills · Skill Both about baseline | 60 | ★ 151 | ≈21 always | 16d ago |
| baseline-forecasting skforecast/skforecast · Skill Both about baseline | 71 | ★ 1.5k | ≈24 always | 16d ago |
| android-benchmark-comparison chrisbanes/skills · Skill Both about comparison | 67 | ★ 1.1k | ≈69 always | 16d ago |