learn-ai-hr-with-phoebe / HR session 10 of 10
Learn AI + HR with Phoebe · HR track · Session 10 of 10

Capstone: one wave, one cycle, and a file you could hand an auditor

Week 26 at Kestrel. Forty roles left to fill, a performance cycle closing, engineering attrition still elevated, and everything you built in b1 to b9 running at once. Tonight you run the whole quarter end to end, produce the five artifacts that make it defensible, and name the four things you will never hand to a machine no matter how good it gets.

🔴 HR track HR partners · recruiters · people ops Full run Finale
0-3 · Welcome 3-15 · The quarter as one map 15-42 · Run it + the never-delegate list 42-45 · Q&A
Part 0

Where we are

Nine sessions of pieces: the workspace and house rules (b1), scorecards and job ads (b2), sourcing (b3), the screen you fixed from a 0.09 four-fifths ratio to 1.00 (b4), structured interviews and calibration (b5), offers and decision records (b6), onboarding (b7), the performance cycle (b8), and the skills map and attrition read (b9). Tonight they stop being nine exercises and become one quarter. The point of the capstone is not more technique - it is the joins, because that is where real HR functions drop things: the impact check nobody ran because hiring was busy, the decision record written a month late, the rejection sent by a template that cited a criterion nobody applied.

Live - presented in session Self-study - read after class ★ Try it now prompt Official sources covered
★ What you walk out with today A run of the full quarter with the two non-negotiable checkpoints in place, five finished artifacts including a wave-level impact check and an audit file index, an explicit list of what you never delegate and why, and a 30-day plan for doing this at your own organisation starting Monday.
Part 1 · the quarter as one pipeline

Everything, in one picture, with two checkpoints 6 min live

Ten stages from scorecard to onboarding, and two places where the process stops until a human does something. Everything else can be drafted, templated, connected and sped up. These two cannot, and a quarter that skips either one is not fast - it is undocumented.

THE QUARTER Scorecard b2 Ad + sourcing b2 · b3 The screen b4 ✋ Impact check before any slate moves Interviews b5 ✋ Named decider reason, same day Offer + record b6 Rejections b6 Onboarding b7 Review cycle b8 · b9 Eight stages can be drafted, templated and connected. The two teal ones stop the line until a person acts. A quarter that skips one of them is not faster, it is unevidenced. Run the impact check on the wave as well as each slate. Twelve seats swing a ratio hard.
🔍 Click to zoom - ten stages, two checkpoints, and what each session built
LiveThe two checkpoints, and why these two3 min▶

Everything else in the pipeline is craft. These two are the difference between a process you can explain and one you can only apologise for.

  • The impact check before any slate is acted on. Selection rates per monitored group, the four-fifths ratio, and a stop if it is under 0.80. Run it per slate and again across the wave, because twelve seats swing a small ratio hard while the aggregate tells you whether it is a pattern. Remember what b4 taught: the check itself fixes nothing, it just makes a silent failure visible in time to fix it.
  • A named decision-maker with a reason, written the same day. Every shortlist, every rejection, every offer, every rating. Not because a form demands it, but because the challenge arrives months later and a rationale reconstructed after the objection reads exactly like one.
Real world

The quarter that was fine until anyone asked. A team ran a clean process on paper: good scorecards, structured interviews, calibrated raters. Then a rejected candidate asked why, eleven weeks later. The criteria existed. The interview notes existed. What did not exist was any record of who made the call or what tipped it, because the decision happened in a corridor between two meetings and everyone remembered it slightly differently. Nothing unlawful occurred. There was simply nothing to show, which in practice is the same problem.

Self-studyWhere the joins usually break2 min read▶
  • Scorecard to screen. The criteria that get screened on quietly stop matching the ones that were agreed, usually because the screen needs something machine-readable and years of experience is easy.
  • Screen to interview. The panel has not read the scorecard, so the structured questions get abandoned in the room for a nice chat.
  • Interview to decision. Evidence exists per rating, and then the decision gets made on the general feeling of the debrief.
  • Decision to record. The record is written when someone remembers, which is when someone complains.
  • Hire to onboarding. The scorecard that defined the role never reaches the manager, so the 30/60/90 measures something else entirely.

Every one of these is a handover between two people who are both busy. That is what the capstone run is for - not to practise the stages, but to practise the seams.

Part 2 · the run

Run Kestrel's quarter ★ 16 min · everyone builds

Short prompts, because the workspace already knows Kestrel. Three artifacts get built live here; the other two are Demo 1. Notice how little instruction each one needs now compared with session b1 - that is what the context pack was for.

Monday - refresh the pack. Update the roles filled, the open slates, the risk of the week, and the last cycle's outputs. Five minutes, and everything downstream depends on it.

Tuesday - the wave impact check. Aggregate selection rates across every role filled this quarter, the four-fifths ratio, and the per-slate view underneath it. If it fails, the escalation from leader session a3 fires today, not next month.

Wednesday - the hiring-manager update. One page per manager: where their roles are, what is blocked, what you need from them, and by when.

Thursday - decisions and records. Offers, rejections, and every decision record written the same day by the person who decided.

Friday - the cycle pass. The performance-cycle evidence pass from b8, and the flagged list of claims with no artifact behind them goes back to managers.

★ Artifact 1 - the wave-level impact checkProduce this quarter's hiring impact check from the aggregate data in the pack. - Selection rate per monitored group, per stage: applied, screened in, interviewed, offered. - The four-fifths ratio at each stage: lower group's rate divided by the higher group's. - Flag any stage below 0.80, and say which stage the drop first appears at - that is where the process problem is, not necessarily where it shows up. - Compare against the previous quarter and name what changed in the process between them. - Use aggregate monitoring data only. Never name, score or infer anything about an individual candidate. - End with: what I should stop doing today if any stage fails, and who I must tell.
★ Artifact 2 - the weekly hiring-manager updateDraft one update per hiring manager from the pack. Each one: where each of their roles stands, what is blocking it, the decision I need from them and by when, and any slate waiting on their review. One page, no adjectives about candidates, no names in any summary that goes to a manager other than their own. Mark anything not in the pack as "TBC - ask [role]". Do not estimate a fill date.
★ Artifact 3 - the performance-cycle evidence passFor each review draft in the cycle folder, list only: 1) claims with no artifact, date or incident behind them, 2) developmental sentences that are vaguer than the praise in the same review, 3) any comparison to another person, named or unnamed. Do not rewrite anything. Do not produce or suggest a rating. This is a checklist that goes back to the manager, not an edit.
What to notice while you run it Every prompt above refuses something: no individual scoring, no invented dates, no rewriting, no ratings. That is not defensive drafting for its own sake - each refusal is a boundary one of the previous nine sessions established, and together they are the reason this quarter would survive being examined. A prompt with no refusals in it is usually a prompt that will produce something you have to defend later.
Part 3 · the list that does not change

What you never delegate, and why 5 min live

Not because a model cannot produce words for these, but because in each one the accountability is the substance. Something is at stake for the person on the other side, and nothing is at stake for the machine.

NEVER The decision hire, rate, promote, exit - about a person The bad news the message that costs you something to send The hard talk someone struggling, grieving, or leaving The bar what good enough means here EVERYTHING ELSE Scorecards · ads · outreach · guides · plans · summaries · updates · knowledge bases Draft it, template it, connect it, speed it up. This is where the hours come back. The test: is anything at stake for the person on the other side? Then it is yours.
🔍 Click to zoom - four things that stay human, and the large territory that does not have to
LiveWhy each one, in a sentence2 min▶
  • The decision about a person. It is regulated, it is consequential, and being accountable for it is the entire job. A ranked list is an input; the decision is a person's act.
  • The bad news. A rejection or a hard rating delivered by something with nothing at stake reads exactly like what it is. The cost of sending it is part of what makes it honest.
  • The conversation where someone is struggling. Illness, burnout, a grievance, a resignation. There is no draft for the moment somebody tells you the truth.
  • The judgment about the bar. What "good enough" means at your company is a values decision that shapes who gets in and who gets ahead. A model will happily infer it from your history, which is precisely the thing you are trying not to repeat.
The one-line test Is anything at stake for the person on the other side? If yes, a named human does it and records why. Everything else is drafting, and drafting is where the hours you got back this quarter actually came from.
Part 4 · what you could hand over tomorrow

The audit file 3 min live

Not a compliance exercise for its own sake. If you can produce these rows on request, your process is real; if you cannot, the quality of your intentions is not going to help. Any missing row is this quarter's work, in priority order.

RowWhat it isBuilt in
CriteriaThe scorecard per role, with each must-have evidenceableb2
SlatesWho was in the pool at each stage, not just who came outb3 · b4
EvidenceWhat supported each rating, per candidate, per criterionb4 · b5
Decision recordsWho decided, their reason, the date it was writtenb6
Impact checksSelection rates and the four-fifths ratio, per slate and per waveb4 · tonight
NoticesWhat candidates were told about AI use, and when it was sentb1
Tool versionsWhich tool and version was in use for each decision periodb1 · leader a3
Real world

Six rows out of seven. A people team ran this inventory expecting to fail it and found they had six of the seven already, scattered across an ATS, a shared drive and somebody's inbox. The missing row was tool versions, which nobody had thought to record - and which mattered, because their vendor had shipped a model change mid-quarter that nobody could date afterwards. Producing the file took a fortnight. Not producing it would have taken an incident.

Demo 1 of 2

The two remaining artifacts ★ 10 min · everyone builds

You built three in Part 2. These are the last two - one complete decision record, and the audit file index for the quarter.

Take one filled role and assemble the complete decision record: criteria, slate, evidence per rating, the named decider and their reason, the impact check result, and the tool in use.

Read it as if you were the rejected runner-up. Anything you would find unanswerable is a gap.

Build the audit file index for the quarter - the seven rows, where each lives, who owns it, and which are missing.

Rank the missing rows by how long they would take to start producing. Start with the cheapest, this week.

★ Artifact 4 and 5 - the record and the index1) Assemble the complete decision record for [role] from the pack: criteria used, slate at each stage, evidence per rating, the named decision-maker and the reason in their own words, the impact check result for that slate, and the tool version in use. Mark every gap as "MISSING - [what is absent] - ask [role]". Do not fill a gap by inference, and do not write a rationale the evidence does not support. 2) Then build the quarter's audit file index: the seven rows (criteria, slates, evidence, decision records, impact checks, notices, tool versions), where each currently lives, who owns it, and which rows we could not produce today.
The version that produces a file nobody can rely onSummarise our hiring this quarter and write up why each hire was the right call.
Demo 2 of 2

Your own 30 days ★ 8 min · build your own

Kestrel is fictional. Your Monday is not. Four weeks, one artifact each, in the order that gets you defensible fastest rather than the order that is most fun.

Week 1 - the workspace and house rules. Six documents, none of them personal data, plus your never-list. Two hours, and everything else gets easier.

Week 2 - one role scorecard, done properly. Every must-have evidenceable. Use the role you are hiring for right now, not a hypothetical one.

Week 3 - the impact check on your last five roles. Aggregate, monitoring data only. Whatever the number, you will know something on Friday that you did not know on Monday.

Week 4 - the screening protocol. The six levers from b4 written down, with who runs the check and what happens when it fails.

Pick your measures now, before you start: hours moved off drafting, share of criteria that are evidenceable, share of decisions with a same-day recorded reason, and the four-fifths ratio across the wave. Time-to-hire on its own is the one to distrust - it falls fastest when you skip the checks.

The order matters more than the speed Most teams start at the screen, because that is where the hours are. Starting there means running an unaudited automated decision before the house rules exist. Weeks 1 and 2 look slow and are what make week 4 defensible - and week 3 is the one that tells you whether you had a problem all along.
The close

Three rails, and a habit 2 min live

Ten sessions come down to three sentences and one discipline.

And the habit: check the current position before you act. The EU AI Act's employment obligations moved from August 2026 to 2 December 2027 while this course was being written, and NYC's rules were live years before most teams noticed. Anything in these pages could move again. The craft - structured criteria, evidence, calibration, a human decision, a real record - does not.

Where to go next If your next problem is organisational rather than practical - vendors, audits, board conversations, what your function is allowed to do at all - the leader track (a1 to a6) is that conversation. Leader session a3 is the one to forward to whoever owns compliance where you work.
Homework

Try it yourself - the next 30 days ◐ one artifact per week

Source material

Official sources covered

The capstone draws on every source in the course. This is education for HR professionals, not legal advice, and obligations vary by jurisdiction - verify the current position before you act. This session covers:

✓EEOC Uniform Guidelines - four-fifths rule, applied at wave levelPart 1-2 · the aggregate check
✓NYC Local Law 144 - audit, public summary, candidate notice, recordsPart 4 · the audit file rows
✓EU AI Act - employment high-risk scope, oversight, record-keepingPart 1 + close · the checkpoints and the moving date
✓GDPR + PDPA - aggregate monitoring data, minimisation, retentionPart 2 · what the impact check may use
Check yourself

Three questions before you go 🎯 ◐ 90 seconds

1 · Which two points in the pipeline stop the line until a human acts?

Everything else can be drafted, templated and connected. These two are what make the quarter explainable afterwards - and a process that skips either one is not faster, it is unevidenced.

2 · Your wave-level impact check passes at 0.86 but one individual slate came in at 0.50. What does that tell you?

One seat moves a twelve-person ratio a long way, which is why you run both. A failing slate inside a passing wave is a prompt to examine that slate's criteria and raters - a signal that starts an investigation, not a verdict on its own.

3 · What is the test for whether something belongs on the never-delegate list?

The decision, the bad news, the hard conversation and the bar - in each one the accountability is the substance, and the model has nothing at stake. The legal question is narrower than the right question, and drafting quality is not the point at all.

HR session 10 cheat sheet · pin this

Two checkpointsimpact check before a slate moves · named decider with a same-day reason on every outcome.
Check both levelsper slate and across the wave. Twelve seats swing a small ratio hard.
The seams break, not the stagesscorecard to screen, interview to decision, decision to record, hire to onboarding.
The audit filecriteria · slates · evidence · decision records · impact checks · notices · tool versions.
Never delegatethe decision about a person · the bad news · the hard conversation · the bar.
The testis anything at stake for the person on the other side? Then a named human does it.
30 daysworkspace · one scorecard · the impact check on five past roles · the screening protocol.
Distrust time-to-hireit drops fastest when the checks get skipped. Measure evidence and records instead.