mirror of
https://github.com/bdbrown4/peltier.io.git
synced 2026-11-07 19:08:27 +00:00
Claude
535821cd48
The Claude Agent SDK loop (agent/hotpath_agent/loop.py, model claude-fable-5) drives the seven harness tools over a standalone stdio MCP server (mcp_server.py) and runs the full profile -> hypothesize -> patch -> gated-verdict cycle on comrak with no human in the loop. Three audited attempts, all honest rejections, ZERO false accepts: - phase2-comrak-001 class 3: syntect buffer with_capacity, [0.971,1.007] - phase2-comrak-002 class 5: gate dead VecDeque build, [0.982,1.026] - phase2-comrak-003 class 6: hoist find_special_char check, [0.970,1.007] The agent picked the cheapest untried class each time (3->5->6) and TWICE refused to fabricate a verdict it couldn't read back, verifying ledger integrity instead — the anti-reward-hacking behavior SPEC §10 targets. Harness changes surfaced by the loop: - run_verdict is now async: launches the multi-minute build+bench detached (past the 60s MCP transport cap) and returns immediately; new read_verdict op polls the append-only ledger row (ledger verdict_summary). Fixes attempt 001's unreadable-verdict gap. - read_target_source takes offset/limit line windows so 100KB+ files page instead of overflowing — removes the agent's reason to reach for a shell (attempt 003 paged a 2400-line file cleanly, no shell). Honest boundary note (case study + code comments): in THIS dev container the SDK tool allow/deny layer is defense-in-depth, not the trust boundary — a nested CLI as root under a parent session doesn't reliably gate built-ins. SPEC §10's boundary is OS process/user isolation; that hardening is the remaining Phase 2 exit item (docs/infra.md). What holds regardless: propose_patch is the only mediated write path (path-allowlist + git apply) and the ledger is append-only. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01EcKPWQ3MQD4NdEHwar96u2
76 lines
2.7 KiB
Python
76 lines
2.7 KiB
Python
"""Standalone MCP stdio server exposing the six harness tools (SPEC §3.5).
|
|
|
|
Spawned as a subprocess by the agent loop; speaks MCP over stdio. Wraps
|
|
the harnessd IPC client — the trust-layer allowlist and gates remain the
|
|
hard boundary. Run standalone for debugging:
|
|
|
|
HOTPATH_REPO_ROOT=/path/to/repo python -m hotpath_agent.mcp_server
|
|
"""
|
|
|
|
from __future__ import annotations
|
|
|
|
import os
|
|
|
|
from mcp.server.fastmcp import FastMCP
|
|
|
|
from . import tools as harness
|
|
|
|
REPO_ROOT = os.environ.get("HOTPATH_REPO_ROOT", ".")
|
|
harness.connect(REPO_ROOT)
|
|
|
|
mcp = FastMCP("harness")
|
|
|
|
|
|
@mcp.tool()
|
|
def read_profile(target: str) -> str:
|
|
"""Latest profile for a target: ranked hotspots with % of instructions."""
|
|
return str(harness.read_profile(target))
|
|
|
|
|
|
@mcp.tool()
|
|
def read_ledger(target: str) -> str:
|
|
"""Prior attempts against a target. Never re-attempt a playbook class listed here."""
|
|
return str(harness.read_ledger(target))
|
|
|
|
|
|
@mcp.tool()
|
|
def read_playbook(class_number: int) -> str:
|
|
"""Optimization playbook class 1-7: preconditions, procedure, verification, failure modes."""
|
|
return harness.read_playbook(class_number)
|
|
|
|
|
|
@mcp.tool()
|
|
def read_target_source(target: str, path: str, offset: int = 0, limit: int = 400) -> str:
|
|
"""Read one file from the target workspace (path relative to the workspace root),
|
|
as a line window: `offset` (0-based first line) and `limit` (max lines). Large
|
|
files (100KB+) MUST be read in windows — the response is truncated otherwise.
|
|
Returns numbered lines plus total_lines/returned_lines/truncated metadata."""
|
|
return str(harness.read_target_source(target, path, offset, limit))
|
|
|
|
|
|
@mcp.tool()
|
|
def propose_patch(target: str, diff: str, hypothesis: str) -> str:
|
|
"""Submit a unified git diff (a/ b/ prefixes, paths relative to the target workspace)
|
|
plus the hypothesis it tests. The harness applies it only after a path-allowlist
|
|
check. Returns a patch_id, or an error string if refused."""
|
|
return harness.propose_patch(target, diff, hypothesis)
|
|
|
|
|
|
@mcp.tool()
|
|
def run_verdict(patch_id: str, run_id: str, playbook_class: int, hotspot: str) -> str:
|
|
"""Launch the gate+bench pipeline on a proposed patch (runs detached, several
|
|
minutes) and return immediately. Poll read_verdict with the same run_id for the
|
|
result; the ledger row is written when the pipeline finishes."""
|
|
return str(harness.run_verdict(patch_id, run_id, playbook_class, hotspot))
|
|
|
|
|
|
@mcp.tool()
|
|
def read_verdict(run_id: str) -> str:
|
|
"""Poll for a completed verdict by run_id. Returns the verdict and speedup CI once
|
|
the ledger row is written, or a 'running' status while the pipeline is still going."""
|
|
return str(harness.read_verdict(run_id))
|
|
|
|
|
|
if __name__ == "__main__":
|
|
mcp.run()
|