SkyWaysThe agentic manual

The evidence pack: what must exist before each AI hand-off

Thirty documents, owed across four hand-offs, and the check that a document exists is the least important check you can run on it.

7 minutesIntermediateLesson 9 of 9Updated By

On this page
  1. Sound familiar?
  2. What is the evidence pack?
  3. Build the pack, step by step
  4. Where you'll use it
  5. Why it matters
  6. Try it
  7. Key takeaways
  8. FAQ
  9. Apply it in your role
  10. Sources and credits
All lessonsStart here

Getting started

  1. What is the agentic PDLC?
  2. How this tutorial works

Agentic PDLC fundamentals

  1. The evolution of the PDLC
  2. Why agentic AI projects fail
  3. P0 · Frame
  4. P1 · Design & Spec
  5. The one hard gate
  6. P2 · Build & Prove
  7. P3 · Run & Learn
  8. The eight loops
  9. The evidence pack

Methods decoded

  1. AI-DLC vs AIDD vs agentic SDLC
  2. What is AI-DLC?
  3. What is AIDD?
  4. What is the BMAD Method?
  5. What is spec-driven development?
  6. One lifecycle for every method
  7. How much process a change needs

Running delivery

  1. How to run an agentic AI project
  2. Bolts vs sprints
  3. A board for agentic work
  4. Cut delivery from months to weeks
  5. Review AI code by risk
  6. How accurate must an agent be?
  7. Prove the agent meets its bar
  8. Shadow mode and cut-over
  9. Why the AI bill is 4× the estimate
  10. Guardrails that hold
  11. The five governance gates
  12. Catch AI drift
  13. AI incident postmortems

By role

  1. For product managers
  2. For program managers
  3. For solution architects
  4. For engineers
  5. For forward-deployed engineers
  6. For QA
  7. For DevOps and platform
  8. For business sponsors
  9. For executives

Teams and organisation

  1. Team structure for agentic AI
  2. Measuring AI productivity
  3. The maturity model
  4. Rolling it out in 90 days

Practice

  1. The SkyWays case study
  2. The operating rhythm
  3. The workbench
  4. Twelve exercises

Interviews and careers

  1. What is an FDE?
  2. Six answer frameworks
  3. AI PM interview questions
  4. FDE interview questions
  5. GenAI engineer questions
  6. Agentic engineer questions
  7. AWS GenAI questions

In short

The evidence pack is the minimum set of artefacts owed at each hand-off of the agentic PDLC, kept on one dated index. Owed means the next phase would have to invent it otherwise. The pack is checked not only for whether each artefact exists and is current, but for whether each control it describes is enforced in code or only written down.

The evidence packwhat must exist before each hand-offP0 → P1Soft · 7 owedtest: can thearchitect designwithout asking?Pain, AI-fit,valueAutonomyRequirements,constraints,NFRsP1 → P2HARD · 9 owedtest: can an outsiderbuild bolt one alone?Spec, barsheet, ADRsStep map,authorityTopology,contextStory files, 50casesP2 → P3Soft · 8 owedtest: is the bar arunning check?Bolt plan, lowerboundReview lanes,harnessCheckers,gated toolsShadow,cut-overP3 → P0Soft · 6 owedtest: does the nextbrief have an owner?Two numbers,driftRedactedtrace, billIncident,maturityA phase ends on an artefact, not a date. Each hand-off has a test; an empty line reads as a blocked merge.

The evidence pack what must exist before each hand-off

P0 → P1Soft · 7 owedtest: can the architect design without asking?
  • Pain, AI-fit, value
  • Autonomy
  • Requirements, constraints, NFRs

P1 → P2HARD · 9 owedtest: can an outsider build bolt one alone?
  • Spec, bar sheet, ADRs
  • Step map, authority
  • Topology, context
  • Story files, 50 cases

P2 → P3Soft · 8 owedtest: is the bar a running check?
  • Bolt plan, lower bound
  • Review lanes, harness
  • Checkers, gated tools
  • Shadow, cut-over

P3 → P0Soft · 6 owedtest: does the next brief have an owner?
  • Two numbers, drift
  • Redacted trace, bill
  • Incident, maturity

A phase ends on an artefact, not a date. Each hand-off has a test; an empty line reads as a blocked merge.

In this lesson you'll learn:

  • what makes an artefact owed rather than merely useful;
  • the minimum set at each of the four hand-offs, and the test for each;
  • why "enforced, or only written?" is the most important column in the pack.

Sound familiar?#

  • An auditor asks why the refund cap is $400, and the answer is in somebody's memory.
  • A new engineer spends the first week asking questions the design documents should have answered.
  • Every document exists, every checkbox is ticked, and the control it describes still failed in production.

The pack exists for all three, and the third is why existence is the weakest thing you can check.

What is the evidence pack?#

The evidence pack is the minimum artefact set of the agentic PDLC: the few documents owed at each hand-off between phases. Together they are what you show an auditor, a new team member, or yourself in six months when nobody remembers why the cap is what it is.

An artefact is owed when the next phase cannot start properly without it: the test is not whether someone wants it, but whether the next phase would otherwise have to invent it. Everything else is optional: keep it if somebody reads it, delete it if not.

artefactthe phase ends when this crossesnot on Friday
Mental model A phase ends on an artefact, not a date

Build the pack, step by step#

Step 1 · Sort every document into one of four states#

StateMeansWhat the next phase does
Owed and presentIt exists, it is current, and the receiving owner has read itStarts
Owed and staleIt exists, and the system has moved past itStarts, then builds on a fiction
Owed and absentIt does not existInvents it, silently and plausibly
Not owedUseful, but nobody downstream is blockedKeep it if read; delete it if not

The dangerous state is the second one. A stale artefact passes every check that asks whether a document exists.

the systemmovedbuilds on a fictionit exists
A stale document passes every check that asks whether it exists. The next phase starts, then builds on a fiction.

Step 2 · Check each hand-off against its test#

Each hand-off has a one-line test, drawn in the map at the top, which also counts what each one owes: seven artefacts at P0 → P1, nine at the hard gate, eight at P2 → P3 and six at P3 → P0. The two tests that matter most:

  • P0 → P1. Can the architect start designing without asking the product manager a question?
  • P1 → P2, the hard gate. Hand the pack to an engineer who was not in the room. If they can build the first bolt without a conversation, the gate is passable.

Step 3 · Add the column nobody adds: enforced, or only written?#

For every control an artefact describes, record where it should live and run a command that proves it does. A cap belongs in a tool signature; an approval rule belongs in the tool and the access policy; "the bar blocks the merge" belongs in branch protection.

ControlShould live inThe check you runResult
$400 refund capThe refund tool's signaturerg "max=400" src/tools/0 hits, NOT ENFORCED
Named approver above the capThe tool, and the access policyrg "approver" src/ infra/prompt only, NOT ENFORCED
The bar blocks the mergeA required status checkread the branch protection rulerequired, enforced

Any control found only in a prompt, a runbook or a document is not enforced, and the pack says so in capitals. SkyWays crossed its hard gate with the authority budget written and not enforced; on day 82 a $2,000 refund went out that the budget forbade. This single column is the difference between a gate and a formality.

Step 4 · Date every artefact#

Give every row a version and a last-changed date, and ask at each review whether the system has moved past it. A spec at version 3 while the code is on the behaviour of version 7 is an owed artefact in the stale state, and it is the one a new engineer will trust.

Step 5 · Keep it on one index page#

The pack is one page: one row per owed artefact, with its hand-off, owner, link, version, last-changed date, whether it is current, and who has read it. Everything else is a link from it. A pack that is a folder of documents is a pack nobody reviews.

Where you'll use it#

  • At every hand-off, as the checklist the receiving owner signs.
  • Before an audit or a regulator's question, as the answer that does not depend on who is in the room.
  • When onboarding an engineer or a new agent session, as the reading list that lets them start.

Why it matters#

The pack is the difference between a decision that was made and a decision that was kept. Most of what goes wrong in an agentic system was decided correctly somewhere (the cap, the approver, the bar) and then never enforced, or enforced once and allowed to go stale.

Try it#

At the end of P1 the authority budget says refunds over $400 need a named approver. The system prompt says "never refund over $400 without approval". A search of the tools folder for the cap returns nothing. Is the P1 → P2 gate passable?

Show the answer

No. The authority budget is owed and present, but the control it describes is written only: it lives in a prompt, which a model can be talked past. The hard gate fails on the enforcement column. The fix is a typed, bounded parameter in the refund tool with two tests beside it; or, if the programme genuinely cannot wait, a written waiver that names this gap, its blast radius and the date it will close.

Key takeaways#

  1. An artefact is owed when the next phase would otherwise have to invent it: thirty across four hand-offs.
  2. Stale is the dangerous state: date every artefact, because existence checks pass it.
  3. "Enforced, or only written?" is the column that turns the pack from paperwork into a gate.

FAQ#

What documentation does an AI project need?#

The minimum is what each phase owes the next: the measured pain, AI-fit verdict, value line and autonomy decisions from framing; the spec, bar sheet, decision records, authority budget and first fifty golden cases from design; the proof and cut-over plan from the build; and the two-number report, drift readout and incident briefs from operation.

What is an AI audit trail?#

A record that lets someone reconstruct, later, what a system decided, why, and under whose authority. In the evidence pack it is the dated index of owed artefacts plus the redacted trace of every consequential action: which model and prompt version decided it, what it did, and who approved it.

How is the evidence pack different from a definition of done?#

A definition of done applies to a piece of work; the evidence pack applies to a hand-off between phases. It also asks a question a definition of done rarely does: whether each control that a document describes is actually enforced.

Is this only for regulated industries?#

No. The pack is small on purpose (thirty short artefacts, most of them one screen) and the enforcement column pays for itself the first time it finds a cap that lives only in a prompt.

Apply it in your role#

If you are…Do thisThe AI-augmented shortcut
A forward-deployed engineerKeep the pack current from day one and hand it over as the deliverable. It is what lets the customer's team run the agent after you leave.Ask a model to check the pack's index against the repository and list stale or missing artefacts.
A product manager or FDPMAt each hand-off, check owed, current and enforced. A control that exists in a document but not in code is marked absent.Have a model compare each control in the pack with the code and quote the line that enforces it.
A GenAI or agentic AI engineerLink every control in the pack to the test that proves it. A control without a test is a claim.Ask a coding agent to generate a test stub for each control that has none.

Across the enterprise. Make the evidence pack the unit of audit: the same index for every product, so an internal auditor can read any team's agent in an hour.

The ten-minute workflow. Check that the controls you describe are the controls you run:

Here is our evidence pack index: <paste>, and the repository is attached. For every control the pack
describes (caps, redaction, gates, bars) find where it is enforced in code and quote the line.
Mark each: enforced with a test, enforced without a test, described only, or missing.

Sources and credits#

IdeaOriginSource
The minimum artefact set, the four states and the enforcement columnOriginal: this manualThe Evidence Pack
Gates opened by evidenceBorrowedCooper, R. G. (1990). Stage-gate systems. Business Horizons 33(3)
Architecture decision recordsBorrowedNygard, M. (2011). Documenting architecture decisions
EARS acceptance syntaxBorrowedMavin, A. et al. (2009). Easy Approach to Requirements Syntax. IEEE RE'09
The SkyWays figuresIllustrative: a fictional airlineThe evidence pack, live

Prefer GitHub? This track is on the wiki, and this lesson is markdown. Found a mistake? Edit this lesson, or say so.