Home / Skills / benchmarking-the-agent

benchmarking-the-agent

amd/gaiaSkill

Measure the flagship GAIA agent against Claude Code and across models — quality, truthfulness, steps, tokens, time and real cost — with `gaia eval tasks`. Use when asked to benchmark the agent, compare models or harnesses, check whether a change cost quality, work out what a run costs, or reproduce the harness × model table.

ScannedSkillSource: GitHub
1,586 stars +14 this week Updated 16d ago License MIT Context ≈87 tokens always loaded
70popular

Why this score

Stars15/35
Usage (forks)5/15
Upkeep25/25
License15/15
Owner history10/10

This repo hosts 10 skills, so its 1,586 stars are split between them (about 159 each) for scoring.

Popularity score: 70/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank

Security

Scanned Oct 21, 2026 at commit b0d240f98bb8, with Cisco's open-source skill-scanner.

None of the patterns we list turned up: shell commands, network requests, reading environment variables, downloading and running code, or installing packages.

A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan

Alternatives

Nothing from another maker does quite the same job yet.