learn-ai-consulting-with-phoebe / Leader session 4 of 6
Learn AI Consulting with Phoebe · Leader track · Session 4 of 6

Quality at AI speed: the partner as editor-in-chief

When drafts were expensive, review was a skim for typos - the analyst had already spent three days on the page, and scarcity did the quality control. Drafts are now close to free, so review IS the job. This session makes that concrete: where the bottleneck moved, the four-pass review pyramid that catches what fluent AI text hides, and why the red pen in your hand is now both the firm's production constraint and its quality moat.

🤝 Leader track Partners + practice leads The review craft 45 min + self-study depth
0-3 · Welcome 3-20 · The bottleneck moved 20-40 · The review pyramid 40-45 · Q&A
Part 0

The red pen is the new production line

Session a3 built the rails; this session builds the craft that runs between them. The old economics hid a truth: review was never really optional, it was just cheap to skip, because expensive drafts arrived pre-filtered by the effort that made them. That filter is gone. What arrives now is fluent, plausible, fast, and unfiltered - and the partner who reads it is the only quality gate left standing. The good news: review is a teachable craft with a structure, not a heroic act of attention. That structure is the pyramid, and you will run it on a real page before you leave.

Live - presented in session Self-study - read after class Sources covered
★ What you walk out with today The one-sentence economics of why review now gates throughput, the four-pass review pyramid with an owner per pass, the anti-slop bar stated as a brand promise, and a diagnosis of which pass is your practice's weak gate.
Leader's framing The consultant track teaches producers to pre-clear these gates - its live scorer prices vague sentences and missing anchors before a partner ever sees the page. Your half is the receiving end: a review discipline that scales with AI-speed volume, and a bar the whole practice can see you hold.
Part 1 · covers the new economics

The bottleneck moved 7 min live

The BCG field study's production numbers - work completed 25.1% faster with GPT-4 - have a second-order consequence nobody prices in on day one: if drafting accelerates and review does not, review capacity, not drafting capacity, now gates the firm's throughput. The queue did not disappear. It moved to the partner's desk.

LiveFluent volume: the new failure mode4 min▶

The old failure mode announced itself: a weak draft read weak, and a rushed analysis looked rushed. The new one does not. Fluent volume is more pages, all plausible, arriving faster than scrutiny scales - every paragraph polished, every error wearing the same confident prose as every fact. The danger is not that the work got worse; it is that bad work stopped looking different from good work at skim speed. Skimming was a viable review strategy precisely when effort correlated with quality. That correlation is gone.

Real worldThe Deloitte Australia incident from session a3 is this failure mode with a headline attached: fabricated references and a misattributed quote, fluent enough to survive every skim between drafting and delivery, caught only when a Sydney University academic did the slow read the firm's review should have done. The pyramid's first pass exists so that read happens inside your building, on your clock.
LiveThe second warning: homogenization3 min▶

The study adds a finding that turns review from a defensive act into an offensive one: AI-assisted answers converge on similar ideas. Un-reviewed work is not just risky - it sounds like every rival's un-reviewed work, because two firms pasting the same prompt get cousins of the same deck.

Review is therefore doing double duty now: catching what is wrong, and adding what only your firm would say. The first duty protects the engagement; the second protects the franchise. Part 3 turns that second duty into a bar the whole practice can hold.

Before - drafting was the bottleneck DRAFT days of analyst time Review a skim Ship Effort pre-filtered quality: a weak draft looked weak. Skimming mostly worked. After - review is the bottleneck Draft 25.1% faster REVIEW the new constraint Ship Fluent volume pools at the un-reviewed gate: more pages, all plausible, faster. The queue did not disappear - it moved from the analyst's desk to the partner's red pen.
🔍 Click to zoom - the bottleneck moved from drafting to review
Self-studySizing your own review gap2 min▶

A quick self-audit for your practice: how many deliverable pages reached clients last month, and how many received a genuinely slow read - facts traced, logic pressed - before shipping? The ratio is your exposure. If drafting volume grows at AI speed and slow-read capacity stays flat, the ratio degrades every month without anyone deciding anything. The fixes are structural, not motivational: review time on the engagement plan as a line item, passes with named owners (Part 2), and rituals that scale scrutiny (the self-study card after the pyramid).

Part 2 · covers the review craft

The review pyramid 8 min live

Four review passes, run cheapest first, each catching a failure the others miss. This is field practice, labeled honestly - the structure working reviewers converge on, not a certified standard. The order matters: a fact error found in pass 1 saves the partner-hour that pass 3 costs, and a page that fails pass 2 is not worth pass 3's attention yet.

LiveFour passes, four failures, four owners5 min▶
PassQuestionWhat it catchesWho runs it
1 · FACTSDoes every number, citation, and quote trace to its source?The Deloitte-shaped failure: fabricated references, misattributed quotes, invented statistics - each fact gets a named ownerThe drafter, then a second pair of eyes
2 · SPECIFICITYIs this OUR client, or any client?Slop - fluent text with zero client anchors; the consultant track's scorer prices exactly this: its AI-written slop draft scores 8 of 100 because anchors are zeroEngagement manager
3 · JUDGMENTWould we sign this recommendation with our name? Does the logic survive a hostile read?Plausible reasoning that collapses under one sharp client questionPartner
4 · VOICEDoes it sound like the firm, not like a model's average?Homogenization - the deck any rival could have shippedPartner, reading aloud

Passes 1 and 2 are delegable and cheap - juniors can run them with a checklist, and the consultant track trains them to. Passes 3 and 4 are why partners exist. A practice that lets partners burn their hours on pass-1 work has its pyramid upside down.

Pass 1 · cheapest FACTS Every number, quote, citation to its source The Deloitte check - named owner per fact Pass 2 SPECIFICITY Our client, or any client? Anchors in? The anti-slop check: slop scores 8 of 100 Pass 3 JUDGMENT Would we sign this with our name? Does the logic survive a hostile read? Pass 4 · dearest VOICE The firm's voice, not a model's average Read it aloud - mark what you'd never say Cheapest first: a fact error caught in pass 1 saves the partner-hour that pass 3 costs.
🔍 Click to zoom - four passes, run cheapest first, each catching a different failure
Self-studyReview rituals that scale3 min▶

Three rituals turn the pyramid from a heroic habit into practice infrastructure. The red-team hour: before any major readout, one hour where a colleague not on the engagement attacks the deck as the client's most hostile reader - pass 3, institutionalized. The second-partner rule: high-stakes decks get a second partner's pass 3 and 4, on the calendar, not as a favor. The read-aloud test: the fastest pass-4 instrument ever devised - sentences a partner would never say out loud have no business shipping under the partner's name. None of these require new tools; all of them require the engagement plan to budget review as work, which is the leader's move.

Part 3 · covers the quality moat

The anti-slop bar as brand 5 min live

Your clients now read AI-fluent text all day - in their inboxes, their vendors' proposals, their own teams' memos. Fluency has stopped signaling effort, and generic competence has stopped signaling anything. What the field study says survives is exactly what homogenized output cannot fake: work that is unmistakably specific and judgment-dense. That is not a style preference. It is the moat.

LiveSetting the bar, out loud4 min▶

The bar, stated as policy: nothing generic ships under the firm's name. Every page carries at least one thing only your firm, on this engagement, for this client, could have written - their number, their constraint, their politics, your judgment call. The study's homogenization finding makes the pure-AI baseline everyone's baseline; a deliverable at that baseline is priced accordingly, which is session a2's lesson arriving from the other direction.

And the bar is set in review, not in a memo. The leader models it by catching slop out loud, kindly - "this paragraph could be about any company; give me the sentence only we could write" - in front of the team. Said kindly, it teaches the whole room in ten seconds what a quality bar sounds like. Said never, the bar does not exist, whatever the memo claims.

Real worldThe consultant track runs this exact contrast as a live experiment: in its deck session, the "let AI write it all" draft scores 8 of 100 - fluent, formatted, zero client anchors, zero quantified support - while the "AI drafts, consultant owns" version of the same page scores 100. Same model, same client facts. The 92-point gap is entirely made of specificity and judgment - the two things review passes 2 and 3 exist to protect.
Self-studyWhere the bar meets the invoice2 min▶

Session a2 asked what happens to pricing when clients know AI did the drafting; this session supplies the answer's other half. What a client cannot get from a model at any price is exactly what the pyramid's upper passes produce: facts a named human stands behind, sentences only your firm could write, and a recommendation a partner will sign. The review discipline is not overhead on the fee - increasingly, it IS the fee. A practice that can show its review structure in a procurement conversation is answering "you used AI, why am I paying?" before it gets asked.

Everyone works

Run the pyramid on one page 🖊 ★ 20 min · everyone works

No lab widget on the leader track - a real page and a red pen are the exercise. Take one page of a recent deliverable from your practice; if nothing is at hand, use the course's Cadence engagement facts as a stand-in exec summary and audit that.

Pick one real page. A recent exec summary, a key slide's narrative, one section of a report. One page only - the point is depth per page, and discovering what a slow read actually costs and catches.

Pass 1 - facts. Mark every number, citation, and quote: source seen, or source absent? No judgment yet, just marks. Count the absences - each one is a Deloitte-shaped exposure with your name on it.

Pass 2 - specificity. Circle every sentence that could apply to any company in the industry. Be ruthless: if swapping the client's name for a rival's changes nothing, circle it.

Pass 3 - judgment. Write, in the margin, the one hostile question this page cannot answer. Every page has one. If you cannot find it, you are reading as the author, not the client.

Pass 4 - voice. Read the page aloud. Mark the sentence you would never say to this client across a table. That sentence is a model's average wearing your letterhead.

Tally which pass found the most. That is your practice's weak gate - the pass to staff, ritualize, or train against first. Bring the tally to session a5; the operating model builds on it.

✦ If you finish early Run pass 2 on the page again, but count the circles as a score: what fraction of sentences are client-specific? Set the number you would demand before your name goes on a page - you have just written your practice's first measurable quality bar.
Before next session

Homework 📝 ◐ 25 minutes

Check yourself

Three questions before you go 🎯 ◐ 90 seconds

1 · With AI in the workflow, the firm's production bottleneck moved...

The study's speed gain means pages arrive faster than scrutiny scales. The queue did not disappear; it moved to the partner's desk - and the new failure mode is fluent volume: more pages, all plausible, none pre-filtered by effort.

2 · The four review passes, in order, are...

Cheapest first, each catching a different failure: facts (the Deloitte-shaped check), specificity (our client or any client?), judgment (would we sign it?), voice (the firm, not a model's average). A fact error caught in pass 1 saves the partner-hour pass 3 costs.

3 · Specificity is a quality gate, not a style preference, because...

Homogenized output converges on what any firm could say, and it reads fluently while doing so. Client anchors are the measurable difference between a deliverable and a confident blog post - which is why the scorer prices them, and why pass 2 circles every sentence that could belong to any company.

Coverage, honestly

What this session covered from the official universe

✓Dell'Acqua et al., "Navigating the Jagged Technological Frontier" (HBS/BCG, 2023)the 25.1% speed finding as the bottleneck-mover, and homogenization as the double duty of review
◐Deloitte Australia 2025 incidentused here as the facts-pass anchor only - session a3 owns the full story and the policy it implies
✓The review pyramid (four passes)field practice, labeled honestly - the structure working reviewers converge on, not a certified standard

Certificates, videos, and graded assessments stay with the official providers - this course teaches the working core.

Leader session 4 cheat sheet

The moveDrafting runs 25.1% faster; review capacity, not drafting capacity, now gates throughput. The queue moved to the partner's desk.
Fluent volumeThe new failure mode: more pages, all plausible, arriving faster than scrutiny scales. Effort no longer pre-filters quality, so skimming stopped working.
HomogenizationAI answers converge - un-reviewed work sounds like every rival's. Review both catches errors and adds what only your firm would say.
The pyramidFour passes, cheapest first: FACTS → SPECIFICITY → JUDGMENT → VOICE. Each catches a failure the others miss.
Passes and owners1-2 are delegable with checklists (drafter, EM); 3-4 are why partners exist. Partners doing pass-1 work is an upside-down pyramid.
The scorer's proofThe consultant track's AI-written slop draft scores 8 of 100 - anchors zero - vs 100 for the consultant-owned page. The 92-point gap is specificity plus judgment.
The barNothing generic ships under the firm's name. Set in review, out loud, kindly - not in a memo.
Rituals that scaleRed-team hour before readouts · second-partner rule on high-stakes decks · the read-aloud test. Budget review as work on the plan.