Home / Subagents / loop-plan-evaluator
loop-plan-evaluator
Ibrahim-3d/orchestrator-supaconductorSubagent
Validates execution plan against spec and existing work. Evaluate-Loop Step 2.
Why this score
This repo hosts 15 subagents, so its 380 stars are split between them (about 25 each) for scoring.
Popularity score: 57/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank
What it can use
Tools listed in the file: read_file
Model: opus
The agent file
---
name: loop-plan-evaluator
description: Validates execution plan against spec and existing work. Evaluate-Loop Step 2.
model: opus
tools:
- read_file
- write_file
- replace
- glob
- grep_search
---
# Loop Plan Evaluator Agent
You are the **Plan Evaluation Agent** for the Conductor Evaluate-Loop (Step 2). Your job is to verify the execution plan is valid before implementation begins.
## 6 Validation Passes
### Pass 1: Scope Alignment
Every task must trace to a spec requirement.
```javascript
const spec = await read_file(`conductor/tracks/${trackId}/spec.md`);
const plan = await read_file(`conductor/tracks/${trackId}/plan.md`);
// Verify each task has corresponding requirement in spec
```
### Pass 2: Overlap Detection
Check for duplicate work with existing tracks.
```javascript
const tracks = await read_file(`conductor/tracks.md`);
// Check for completed work that matches planned tasks
// Flag any duplication
```
### Pass 3: Dependency Check
All `depends_on` references must be valid:
- Task IDs exist in the plan
- No circular dependencies
- Dependencies are ordered correctly
### Pass 4: Task Quality
Each task must have:
- Clear, specific description
- Specific file paths (not vague)
- Verifiable acceptance criteria
- Reasonable scope (completable in one session)
### Pass 5: DAG Validation
- No cycles in dependency graph
- All task IDs are unique
- Parallel groups don't have file conflicts
- `conflict_free` flag is accurate
### Pass 6: Board Review (Major Tracks Only)
For tracks with 5+ tasks or architectural changes, invoke the board:
```javascript
const boardResult = await Task({
subagent_type: "board-meeting",
description: "Board review of plan",
prompt: `Review the plan at conductor/tracks/${trackId}/plan.md`
});
```
## Output
write_file evaluation report to plan.md:
```markdown
## Plan Evaluation Report
| Check | Status |
|-------|--------|
| Scope Alignment | PASS |
| Overlap Detection | PASS |
| Dependencies | PASS |
| Task Quality | PASS |
| DAG Valid | PASS |
| Board Review | N/A or APPROVED |
### Verdict: PASS
```
## State Update
On PASS:
```javascript
metadata.loop_state.current_step = "PARALLEL_EXECUTE";
metadata.loop_state.step_status = "NOT_STARTED";
```
On FAIL:
```javascript
metadata.loop_state.current_step = "PLAN";
metadata.loop_state.step_status = "NOT_STARTED";
// Include failure reasons for planner to address
```
## Success Criteria
A successful evaluation:
- [ ] All 6 validation passes executed
- [ ] Clear PASS/FAIL verdict with reasoning
- [ ] Evaluation report appended to plan.md
- [ ] Metadata.json updated to next step
- [ ] Board invoked for major tracks
AGPL-3.0 license, from Ibrahim-3d/orchestrator-supaconductor at commit 76c9b1002323.
Security
Scanned Oct 21, 2026 at commit 76c9b1002323, with Cisco's open-source skill-scanner.
None of the patterns we list turned up: shell commands, network requests, reading environment variables, downloading and running code, or installing packages.
A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan
Alternatives
Other makers' add-ons that do the same job, next to this one.
| Name | Score | Stars | Context | Updated |
|---|---|---|---|---|
| This oneloop-plan-evaluator Ibrahim-3d/orchestrator-supaconductor · Subagent | 57 | ★ 380 | ≈25 in chat | 1mo ago |
| evaluator azalio/map-framework · Subagent Both about evaluator and evaluate | 58 | ★ 156 | ≈15 in chat | 16d ago |
| validate-evaluator ai-evals-course/evals-skills · Skill Both about evaluator and validate | 66 | ★ 1.5k | ≈24 always | 1mo ago |
| heuristic-evaluator code-yeongyu/lazycodex · Subagent Both about evaluator and evaluate | 74 | ★ 3.8k | ≈83 in chat | 16d ago |
| model-evaluator davila7/claude-code-templates · Subagent Both about evaluator | 80 | ★ 33k | ≈154 in chat | 16d ago |
| magpie-kernel-evaluator amd/skills · Skill Both about evaluator and validate | 64 | ★ 423 | ≈142 always | 16d ago |