scripod.com

What a harness is and how to build one with Claude Agent SDK

How I AI

Jul 08
How I AI

How I AI

Jul 08

Shownote

Everybody is saying, “It’s not the model, it’s the harness,” but almost nobody stops to explain what a harness actually is. So I did. I built one live on the show: a Sentry bug-debugging harness for my company ChatPRD, using the Claude Agent SDK, a custom terminal UI built with the Ink library, and opinionated adapters for Sentry, Linear, GitHub, and Vercel. The harness handles evidence gathering, root-cause analysis, and follow-up artifact creation, all without me needing to type “dear agent, please fix this bug” ever again. I also walk through the architecture, share the code structure, and give you the exact process I used so you can build your own harness for any repetitive, structured workflow in your business. What you’ll learn: 1. What a harness actually is 2. When to build a harness versus when to stick with a general-purpose tool like Claude Code or Codex 3. How to encode specific permissions into a harness 4. The three components every harness needs 5. How I used GPT-5.5 and Claude Opus to build the harness code itself (and where they both initially resisted) 6. How to structure the artifacts your harness produces so the whole team can use the output — Brought to you by: Bolt.new [https://bolt.new/partner/howiai]—Turn your idea into a real product Customer.io [https://www.customer.io/howiai]—Build customer engagement campaigns from a single prompt — In this episode, we cover: (00:00) What is an AI harness? (03:19) When to build a harness (04:33) Why Claire picked bug triage (06:00) Why not just use Claude Code? (07:48) Demo: The custom harness interface (11:04) Architecture: runs, tasks, tools, and artifacts (13:44) Building it with Codex and Claude (15:08) Code map and file layout (16:51) A look at the code (19:18) The live investigation result (21:01) How to build your own harness — Tools referenced: • Claude Agent SDK (Anthropic): https://code.claude.com/docs/en/agent-sdk/overview [https://code.claude.com/docs/en/agent-sdk/overview] • Claude Sonnet 4.6 (model used inside the harness): https://www.anthropic.com/news/claude-sonnet-4-6 [https://www.anthropic.com/news/claude-sonnet-4-6] • Claude Opus (used to build the harness): https://www.anthropic.com/claude/opus [https://www.anthropic.com/claude/opus] • GPT-5.5 (Codex, used to build the harness): https://openai.com/index/introducing-gpt-5-5/ [https://openai.com/index/introducing-gpt-5-5/] • Ink (terminal UI library for Node.js): https://github.com/vadimdemedes/ink [https://github.com/vadimdemedes/ink] • Sentry (error monitoring): https://sentry.io/ [https://sentry.io/] • Linear (project management): https://linear.app/ [https://linear.app/] • GitHub: https://github.com/ [https://github.com/] • Vercel: https://vercel.com/ [https://vercel.com/] — Where to find Claire Vo: ChatPRD: https://www.chatprd.ai/ [https://www.chatprd.ai/] Website: https://clairevo.com/ [https://clairevo.com/] LinkedIn: https://www.linkedin.com/in/clairevo/ [https://www.linkedin.com/in/clairevo/] X: https://x.com/clairevo [https://x.com/clairevo] — Production and marketing by https://penname.co/ [https://penname.co/]. For inquiries about sponsoring the podcast, email jordan@penname.co.

Highlights

This episode demystifies the concept of an AI 'harness' by walking through the live construction of a custom bug-debugging tool. The host builds a terminal-based system using the Claude Agent SDK to automate the entire workflow of triaging, analyzing, and documenting software bugs, moving beyond general-purpose AI coding tools.
00:00
A harness is code around an AI agent that makes it more effective for specific tasks.
03:19
Build a harness for repetitive workflows
04:34
Automating triage, root-cause analysis, and follow-up actions.
06:01
Custom harness automates the entire bug workflow without re-explaining intent.
09:49
The harness automates investigation runs without modifying files
11:04
Harness uses Claude Sonnet 4.6 and connects to Sentry, Linear, and GitHub.
13:45
Codex built the best agent but used the Claude Agent SDK
15:08
The harness is simple, with a high-level index for the TUI and eight files for specific tasks.
16:51
The harness constrains agents to solve specific problems efficiently.
19:18
Harness identified root causes and a blind spot
21:04
A harness is simply structured code around an AI agent.

Chapters

In this episode, we cover:
What is an AI harness?
00:00
When to build a harness
03:19
Why Claire picked bug triage
04:33
Why not just use Claude Code?
06:00
Demo: The custom harness interface
07:48
Architecture: runs, tasks, tools, and artifacts
11:04
Building it with Codex and Claude
13:44
Code map and file layout
15:08
A look at the code
16:51
The live investigation result
19:18
How to build your own harness
21:01

Transcript

Claire Vo: A harness is some code around an AI agent that makes it more effective. Why we've seen people build these specific use case harnesses is sometimes with a specific job, you just want to micromanage a little bit. You just want to be more prescript...