SkyWaysThe agentic manual

How to run an agentic AI project: a step-by-step playbook

The whole lifecycle on one page, in the order you will do it. Each step links to the lesson that goes deeper.

7 minutesBeginnerLesson 1 of 13Updated By

On this page
  1. Sound familiar?
  2. The twelve steps
  3. Where the model helps, and where it must not
  4. Where you'll use it
  5. Why it matters
  6. Try it
  7. Key takeaways
  8. FAQ
  9. Apply it in your role
  10. Sources and credits
All lessonsStart here

Getting started

  1. What is the agentic PDLC?
  2. How this tutorial works

Agentic PDLC fundamentals

  1. The evolution of the PDLC
  2. Why agentic AI projects fail
  3. P0 · Frame
  4. P1 · Design & Spec
  5. The one hard gate
  6. P2 · Build & Prove
  7. P3 · Run & Learn
  8. The eight loops
  9. The evidence pack

Methods decoded

  1. AI-DLC vs AIDD vs agentic SDLC
  2. What is AI-DLC?
  3. What is AIDD?
  4. What is the BMAD Method?
  5. What is spec-driven development?
  6. One lifecycle for every method
  7. How much process a change needs

Running delivery

  1. How to run an agentic AI project
  2. Bolts vs sprints
  3. A board for agentic work
  4. Cut delivery from months to weeks
  5. Review AI code by risk
  6. How accurate must an agent be?
  7. Prove the agent meets its bar
  8. Shadow mode and cut-over
  9. Why the AI bill is 4× the estimate
  10. Guardrails that hold
  11. The five governance gates
  12. Catch AI drift
  13. AI incident postmortems

By role

  1. For product managers
  2. For program managers
  3. For solution architects
  4. For engineers
  5. For forward-deployed engineers
  6. For QA
  7. For DevOps and platform
  8. For business sponsors
  9. For executives

Teams and organisation

  1. Team structure for agentic AI
  2. Measuring AI productivity
  3. The maturity model
  4. Rolling it out in 90 days

Practice

  1. The SkyWays case study
  2. The operating rhythm
  3. The workbench
  4. Twelve exercises

Interviews and careers

  1. What is an FDE?
  2. Six answer frameworks
  3. AI PM interview questions
  4. FDE interview questions
  5. GenAI engineer questions
  6. Agentic engineer questions
  7. AWS GenAI questions

In short

Run an agentic AI project in twelve steps across four phases: in P0, measure the pain, decide whether it needs a model, and set autonomy per action. In P1, map every step, write an eight-field spec with a bar per slice, and put every limit in code; in P2, build in bolts behind a harness and prove it in shadow. In P3, widen on evidence, watch for drift and report what it saved beside what it cost.

What actually changedWhere the model helps, and where it must notThe machine took the drafting. It did not take the judgement; it concentrated it. Every step in this manual names a tool, a use, a caution, and exactly one thing that is never delegated.
Read the red column first
Forty lines, one shape. Each of the forty steps names one thing that is never delegated, and every one is a fact about your business, your regulator or your ledger that no context window makes knowable from outside.
The job did not shrink. It is the same judgement, concentrated into fewer and larger decisions, each with a name on it.
P0FramePain, AI-fit and the ceiling
The model drafts
  • Distinct pains from six transcripts, deduplicated
  • Counts from a ticket export, with the script it ran
  • Cost-per-case arithmetic, assumptions in named cells
You check
  • Every line still carries the name of who said it
  • The script counted the right date column
  • A sceptic can move one cell and watch the answer move
Never delegated
  • Which pain is worth solving
  • Whether a wrong action can be undone
  • The autonomy level itself
P1Design & SpecSpec, bar and authority
The model drafts
  • The constraint register, sorted by type
  • A first pass at the agent map, every step tagged
  • The eight-field spec from the brief and the notes
You check
  • The register separates real constraints from habits
  • A $400 threshold is policy, not folklore
  • Each bar was derived from two money figures, not chosen
Never delegated
  • The read-back, to the person who said it
  • What counts as money
  • The bar and the autonomy fields
P2Build & ProveFloor, harness and shadow
The model drafts
  • The deterministic floor from the exact-code inventory
  • Checker implementations and a first judge rubric
  • Golden-set candidates pulled from real traffic
You check
  • The boundary line says what the system must refuse
  • The judge agrees with human labels on a fresh sample
  • The harness runs in cost order and blocks the merge
Never delegated
  • The never-touch list
  • The expected outcome on every golden case
  • The verdict: proven, failed or unproven
P3Run & LearnTrace, bill and the next brief
The model drafts
  • The trace schema and a starting alarm set
  • The bill decomposed into its four factors
  • A draft of the two-number report
You check
  • The factors multiply back to the bill you were sent
  • The blast radius of each new permission is named
  • Drift is measured against the launch set, not last week
Never delegated
  • What is masked and what is kept
  • Declaring the incident over
  • What the sponsor sees

In this lesson you'll learn:

  • the twelve steps of an agentic AI project, in order, with the owner of each;
  • what each step leaves behind, so you know when it is done;
  • where the model helps at each step, and the one decision per phase it must never make.

Sound familiar?#

  • The project plan is a Gantt chart with "build the agent" as one bar in the middle.
  • Nobody can say who decides whether the agent is good enough to launch.
  • The steps exist, but in the wrong order: the prototype came first and the requirements were written around it.

The order is the point. Every step below makes a later one cheaper, and doing them out of order is how agentic projects end up rebuilt.

prototyperequirementsdug in after
Build the prototype first and the requirements get written around it. The order of the twelve steps is the point.

The twelve steps#

P0 · Frame: is it worth doing, and is it AI at all?#

Step 1 · Measure the pain. Turn the request into one line: who has the problem, how often, what it costs today, and the evidence. Owner: product manager. P0 Frame

Step 2 · Decide whether it is AI at all. A genuine judgement call? Enough volume? Recoverable if wrong? Two or three of your top five requests will come back as rules. Owner: product manager.

Step 3 · Size the value and set autonomy per action. Net value after running and checking it, and an autonomy level for each action from what a mistake costs. Owner: product manager, with the sponsor.

P1 · Design & Spec: what exactly, and under whose authority?#

Step 4 · Map every step. Tag each step exact, best-guess or consequential; exact work goes in code. Owner: solution architect. P1 Design & Spec

Step 5 · Write the eight-field spec and derive the bars. One screen, acceptance in EARS, a bar per slice from damage and saving. Owner: product manager, with QA. How accurate an agent must be

Step 6 · Set the authority budget, and sign the hard gate. Every tool banded, every cap in a signature with a test. Nothing enters P2 until the spec, the bars and the budget are signed. Owner: solution architect. The hard gate

P2 · Build & Prove: does it meet the bar, slice by slice?#

Step 7 · Cut bolts, walking skeleton first. One unknown per bolt, cut by dependency, integrated the same day. Owner: engineering lead. Bolts vs sprints

Step 8 · Build the exact floor and the gated tools. Functions and tests before prompts; caps that raise; confirmation tokens the model cannot mint. Owner: engineering lead. Guardrails that hold

Step 9 · Put the harness in CI. Golden cases per slice, the lower bound reported, a merge blocked when a touched slice falls below its bar. Owner: QA lead. Prove the bar

Step 10 · Run it in shadow. The agent decides on live traffic and acts on nothing; agreement per slice over a window fixed in advance. Owner: QA lead. Shadow and cut-over

P3 · Run & Learn: is it still true, and what did it cost?#

Step 11 · Cut over at 5%, widen on evidence, rehearse the rollback. Each widening names the evidence that earned it. Owner: product manager and DevOps. P3 Run & Learn

Step 12 · Watch, report, and feed the next P0. Drift against two thresholds; the saving beside the spend; every incident turned into a control and a brief. Owner: sponsor. Drift · Postmortems

Where the model helps, and where it must not#

The board above draws it phase by phase: the model drafts, you check, and one thing per step is never delegated. The model can draft the pain register from interview notes, the spec from the PRD, the tests from the spec and the postmortem from the trace. It must not decide what a mistake costs your business, which actions it may take alone, whether a slice is good enough, or who is accountable: those are facts about your business, regulator and ledger that no context makes knowable from outside.

Where you'll use it#

  • As the project plan's skeleton: twelve steps, each with an owner and an artefact, instead of one "build the agent" bar.
  • In a kick-off, to show every role where it is accountable, and where it deliberately is not.
  • As an audit checklist for a project already under way: find the first step that was skipped.

Why it matters#

Most agentic projects have the right activities in the wrong order. The prototype arrives before the pain is measured, so the value is unknown; the build starts before the bar is set, so "good enough" is argued at launch; the cap is decided in a document and enforced nowhere. The order in this list is what prevents each of those.

Try it#

A team has a working prototype of a refund agent, a slide deck, and a launch date six weeks away. Which of the twelve steps is most likely to have been skipped, and what does it cost to do now?

Show the answer

Most likely steps 1, 5 and 6 (the measured pain, the bar per slice and the authority budget) because a prototype-first project jumps from an idea to step 8. Doing them now is still cheap: a pain line and a value line are an afternoon; the bars are arithmetic once the damage and saving per slice are known; and the authority budget is a table plus a typed cap and two tests in the refund tool. What is expensive is skipping them and discovering the gaps after launch.

Key takeaways#

  1. Twelve steps, four phases, one owner each, and the order is what makes later steps cheap.
  2. Every step leaves an artefact, so "done" is something a sceptic can open.
  3. The model drafts, you check, and one decision per step is never delegated.

FAQ#

What are the steps of an AI project?#

Measure the pain; decide whether it needs AI; size the value and set autonomy; map every step; write the spec and derive the bars; set the authority budget; cut bolts; build the exact floor and gated tools; put the harness in CI; run in shadow; cut over and widen; then watch, report and feed the next cycle.

How long does an agentic AI project take?#

It depends less on building than on evidence. A small change can run all twelve steps in an afternoon; a new agent typically takes weeks, and the longest single wait is usually the live evidence needed to widen a cut-over, which is set by traffic, not effort. SkyWays, this manual's worked example, ran ninety days.

Who should lead an agentic AI project?#

Each phase has one accountable owner (product manager, solution architect, engineering lead, and the sponsor for the running system) and the sponsor owns the lifecycle as a whole. A programme or delivery manager runs the cadence and the board across them.

What is the most common mistake?#

Building a prototype first and writing the requirements around it. The prototype then decides the autonomy, the architecture and the bar by default, and the team spends the rest of the project defending decisions nobody made on purpose.

Apply it in your role#

If you are…Do thisThe AI-augmented shortcut
A forward-deployed engineerRun this lesson's twelve steps inside Deliver, the second stage of your own guide, and make their phase exits the milestones in the statement of work. They are testable; dates are not.Ask a model to turn these twelve steps into a customer-specific plan for the Deliver stage, with an owner and an artefact per step.
A product manager or FDPMTrack each slice by the step it has evidence for, not by percent complete. A slice "in build" without a bar is still in step 5.Have a model audit the board and move each card back to the step its evidence supports.
A GenAI or agentic AI engineerAutomate the evidence: the harness, the per-call log and the drift job make steps 8 to 12 cheap to prove.Ask a coding agent to scaffold all three in the repository on day one.

Across the enterprise. Run every AI project on the same twelve steps. The portfolio view is then comparable (which step, which evidence, which owner) whatever method each team uses inside it.

The ten-minute workflow. An honest status report in one prompt:

Here is our project status: <board export or notes>. Place each piece of work at the step it has
evidence for, not the one claimed: measure the pain, AI-fit, autonomy, step map, eight-field spec,
authority in code, bolts, harness, shadow, widen, drift, two numbers. List what each needs to move on.

Sources and credits#

IdeaOriginSource
The twelve steps, their order and ownersOriginal: this manualThe Agentic PDLC · Gates and Governance
The model drafts, you check, one thing never delegatedOriginal: this manualThe Agentic PDLC
Gates opened by evidenceBorrowedCooper, R. G. (1990). Stage-gate systems. Business Horizons 33(3)
BoltsAdaptedRaja SP (2025). AI-Driven Development Life Cycle. AWS
The SkyWays timelineIllustrative: a fictional airlineThe workbench

Prefer GitHub? This track is on the wiki, and this lesson is markdown. Found a mistake? Edit this lesson, or say so.