
A Live, Hands-On Intro to Building with AI Agents
Kyle Hoehns · Source Allies
Kyle Hoehns
Staff Software Engineering Consultant · Source Allies
LIVE CODING AHEAD
LEVEL 0 / 6
Blank repo. One trivial endpoint. Zero AI.
Demo: this is our baseline.
LEVEL 1 / 6 · GITHUB COPILOT · HAIKU
Ask a question, paste a snippet.
Watch: it answers, but your hands still do all the work.
LEVEL 2 / 6 · GITHUB COPILOT · HAIKU
Describe the intent; it makes the edit.
Watch: you stop typing code and start directing it.
LEVEL 3 / 6 · SWITCH TO CLAUDE CODE · SONNET
It adds persistence, runs the build, and fixes its own errors.
Watch: the self-correction loop. (Gotcha next.)
AGENTS.md with project context.AGENTS.md with what they need every interaction — build & test commands, how you write tests, version gotchas (“don't use Java 21 features”). Capture what they get wrong, not niche trivia.LEVEL 4 / 6 · BACK TO HAIKU · ON PURPOSE
A custom skill auto-triggers and applies your conventions.
Watch: it picks the right imports without being told.
tools.jackson and relocated @AutoConfigureMockMvc. A fast model confidently used the old imports.LEVEL 5 / 6 · SONNET
Quality gates — coverage and formatting — fail the build until the agent complies.
Watch: the same change goes red, and the agent writes the tests itself.
./gradlew build goes red on the 80% coverage gate.A failing build is the clearest spec you can hand an agent — enforce it, don't hope for it.
Spec it, scope it, define done — that's what makes it safe to hand off.
LEVEL 6 / 6 · SONNET
A skill orchestrates a team to build a feature — a four-wide review + docs fan-out.
Watch: the parent delegates, collects, and applies fixes.
Managing this window is the real skill now — “context engineering.” Sub-agents are firewalls: each floods its own window with noise, hands back only signal.
A skill changes behavior; a sub-agent protects context — and they compose. Stack them and one command can run your whole pipeline.
ship-feature spends most of its steps on review — the gates, three scoped reviewers, and the bots on the PR.Your job moves up the stack: delegate, review, own.
Start small: pick one bounded task, let the assistant draft it, you review.