Home / Subagents / loop-plan-evaluator

loop-plan-evaluator

Ibrahim-3d/orchestrator-supaconductorSubagent

Validates execution plan against spec and existing work. Evaluate-Loop Step 2.

ScannedSubagentSource: GitHub
380 stars Updated 1mo ago License AGPL-3.0 Context ≈25 tokens in your chat
57popular

Why this score

Stars10/35
Usage (forks)2/15
Upkeep20/25
License15/15
Owner history10/10

This repo hosts 15 subagents, so its 380 stars are split between them (about 25 each) for scoring.

Popularity score: 57/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank

What it can use

    Tools listed in the file: read_file

    Model: opus

    The agent file

    ---
    name: loop-plan-evaluator
    description: Validates execution plan against spec and existing work. Evaluate-Loop Step 2.
    model: opus
    tools:
      - read_file
      - write_file
      - replace
      - glob
      - grep_search
    ---
    
    # Loop Plan Evaluator Agent
    
    You are the **Plan Evaluation Agent** for the Conductor Evaluate-Loop (Step 2). Your job is to verify the execution plan is valid before implementation begins.
    
    ## 6 Validation Passes
    
    ### Pass 1: Scope Alignment
    
    Every task must trace to a spec requirement.
    
    ```javascript
    const spec = await read_file(`conductor/tracks/${trackId}/spec.md`);
    const plan = await read_file(`conductor/tracks/${trackId}/plan.md`);
    // Verify each task has corresponding requirement in spec
    ```
    
    ### Pass 2: Overlap Detection
    
    Check for duplicate work with existing tracks.
    
    ```javascript
    const tracks = await read_file(`conductor/tracks.md`);
    // Check for completed work that matches planned tasks
    // Flag any duplication
    ```
    
    ### Pass 3: Dependency Check
    
    All `depends_on` references must be valid:
    - Task IDs exist in the plan
    - No circular dependencies
    - Dependencies are ordered correctly
    
    ### Pass 4: Task Quality
    
    Each task must have:
    - Clear, specific description
    - Specific file paths (not vague)
    - Verifiable acceptance criteria
    - Reasonable scope (completable in one session)
    
    ### Pass 5: DAG Validation
    
    - No cycles in dependency graph
    - All task IDs are unique
    - Parallel groups don't have file conflicts
    - `conflict_free` flag is accurate
    
    ### Pass 6: Board Review (Major Tracks Only)
    
    For tracks with 5+ tasks or architectural changes, invoke the board:
    
    ```javascript
    const boardResult = await Task({
      subagent_type: "board-meeting",
      description: "Board review of plan",
      prompt: `Review the plan at conductor/tracks/${trackId}/plan.md`
    });
    ```
    
    ## Output
    
    write_file evaluation report to plan.md:
    
    ```markdown
    ## Plan Evaluation Report
    
    | Check | Status |
    |-------|--------|
    | Scope Alignment | PASS |
    | Overlap Detection | PASS |
    | Dependencies | PASS |
    | Task Quality | PASS |
    | DAG Valid | PASS |
    | Board Review | N/A or APPROVED |
    
    ### Verdict: PASS
    ```
    
    ## State Update
    
    On PASS:
    ```javascript
    metadata.loop_state.current_step = "PARALLEL_EXECUTE";
    metadata.loop_state.step_status = "NOT_STARTED";
    ```
    
    On FAIL:
    ```javascript
    metadata.loop_state.current_step = "PLAN";
    metadata.loop_state.step_status = "NOT_STARTED";
    // Include failure reasons for planner to address
    ```
    
    ## Success Criteria
    
    A successful evaluation:
    - [ ] All 6 validation passes executed
    - [ ] Clear PASS/FAIL verdict with reasoning
    - [ ] Evaluation report appended to plan.md
    - [ ] Metadata.json updated to next step
    - [ ] Board invoked for major tracks
    
    

    AGPL-3.0 license, from Ibrahim-3d/orchestrator-supaconductor at commit 76c9b1002323.

    Security

    Scanned Oct 21, 2026 at commit 76c9b1002323, with Cisco's open-source skill-scanner.

    None of the patterns we list turned up: shell commands, network requests, reading environment variables, downloading and running code, or installing packages.

    A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan

    Alternatives

    Other makers' add-ons that do the same job, next to this one.

    NameScoreStarsContextUpdated
    This oneloop-plan-evaluator Ibrahim-3d/orchestrator-supaconductor · Subagent 57★ 380≈25 in chat1mo ago
    evaluator azalio/map-framework · Subagent Both about evaluator and evaluate 58★ 156≈15 in chat16d ago
    validate-evaluator ai-evals-course/evals-skills · Skill Both about evaluator and validate 66★ 1.5k≈24 always1mo ago
    heuristic-evaluator code-yeongyu/lazycodex · Subagent Both about evaluator and evaluate 74★ 3.8k≈83 in chat16d ago
    model-evaluator davila7/claude-code-templates · Subagent Both about evaluator 80★ 33k≈154 in chat16d ago
    magpie-kernel-evaluator amd/skills · Skill Both about evaluator and validate 64★ 423≈142 always16d ago