learn-ai-consulting-with-phoebe / Leader session 3 of 6
Learn AI Consulting with Phoebe · Leader track · Session 3 of 6

The two rails: confidentiality and liability, as policy

Every firm's AI policy is a reaction to somebody's incident. The only question is whose. It is dramatically cheaper to react to other firms' incidents than to your own, so this session tells two of them properly - Samsung's twenty days in spring 2023, and Deloitte Australia's October 2025 headline - and then builds the one-page policy those two stories imply. By the end you will have audited, or drafted, your own.

🤝 Leader track Partners + practice leads The risk session 45 min + self-study depth
0-3 · Welcome 3-22 · Two incidents, two rails 22-40 · Policy anatomy 40-45 · Q&A
Part 0

Why this session is stories first, policy second

Sessions a1 and a2 were about upside: the jagged-frontier gains and what they do to your pricing. This one is about the two ways AI ends a client relationship - a confidentiality leak and an unverified fact - and it works differently from most policy talks. We do not start from a template. We start from two fully told, verified incidents, because a policy whose stories you can retell is a policy your firm will actually follow. Each incident implies one rail; the two rails imply the five sections of the one-page policy; and the last eighteen minutes you spend on yours.

Live - presented in session Self-study - read after class Sources covered
★ What you walk out with today Both incidents told accurately enough to retell to your partners, the consumer-vs-enterprise training rule in one sentence, the five-section policy anatomy, and a marked-up draft or audit of your own firm's policy with its single biggest gap named.
Leader's framing The consultant track drills these rails into hands - b3 builds the research discipline, b8 runs the confidentiality drill where the lab's gate caps an 87-scoring draft at 15 the moment a client name appears. Your job is different: make the policy real. That means budget for enterprise tooling, a named owner, and no exceptions for rainmakers.
Part 1 · covers the confidentiality rail

Incident one: Samsung, and the confidentiality rail 8 min live

The verified story, in three beats. Samsung permitted ChatGPT for employees on March 11, 2023. Within roughly twenty days there were three leaks: semiconductor source code pasted in twice, and an internal meeting transcript pasted in for summarization. By May 2023 the company had banned generative AI on work devices company-wide. Nobody was malicious; the tool was permitted, the tasks were ordinary, and the material left the building anyway.

LiveThe consulting translation: the material is the client's4 min▶

Samsung leaked its own property and could decide for itself how much that hurt. A consulting firm in the same position leaks its client's property - and trust is the product the firm sells. That is the whole translation, and it is why this rail outranks every productivity gain in the course: a firm that is 25% faster and untrusted is not a firm.

The timeline, compressed to the version you will retell:

WhenWhat happened
March 11, 2023Samsung permits ChatGPT for employees
Within ~20 daysThree leaks: semiconductor source code (twice), an internal meeting transcript pasted for summarization
May 2023Company-wide ban on generative AI on work devices

The architecture answer has two layers. Layer one is contractual. Consumer tiers of both major vendors may train on your conversations unless you opt out - their own terms say so, and note that Anthropic's consumer tiers train unless opted out under its September 2025 terms. Enterprise and API tiers do NOT train on business data by default, contractually - OpenAI's enterprise privacy page and Anthropic's commercial terms both state it. The rule shape to memorize: consumer tiers may train unless opted out; commercial/enterprise/API tiers do not train by default.

Layer two is behavioral. Even inside approved enterprise tools, client-identifying material gets anonymized before it enters a prompt. The contract protects you from the vendor; anonymization protects you from everything else - screenshots, misrouted chats, the tool you forgot was consumer-tier.

Real worldNotice what the Samsung employees did NOT do: nothing. They hid nothing, broke no rule, used a permitted tool for normal work - debugging code, summarizing a meeting. The failure was architectural, not moral. That observation returns in Part 3 as the no-blame incident path: a policy that punishes reporting guarantees you learn about your leak from the news instead.
Behavioral layer: anonymize client-identifying material anyway Applies on top of BOTH lanes - names, figures, anything identifying, out before the prompt Consumer lane May train on your chats unless opted out The opt-out is behavioral: a setting someone must remember to flip, per the vendors' terms. Anthropic consumer tiers: train unless opted out, under the September 2025 terms. Enterprise / API lane Does NOT train on business data by default The guarantee is contractual, not behavioral: OpenAI enterprise privacy page, Anthropic commercial terms. This is the lane your firm buys. Rule shape: consumer may train unless opted out; enterprise/API do not train by default.
🔍 Click to zoom - two lanes, one anonymization layer on top of both
Self-studyWhy "opt out" is not a policy2 min▶

A firm could, in principle, run on consumer tools with every employee's opt-out toggled. Do not. A behavioral guarantee degrades one new hire, one reset device, one forgotten toggle at a time - and you will not know it degraded until the incident. A contractual guarantee degrades only if the contract changes, which is visible, negotiable, and somebody's job to watch. When your policy names approved tools in Part 3, the tier is the point: you are buying the contract, not the model.

Part 2 · covers the liability rail

Incident two: Deloitte Australia, and the liability rail 8 min live

The verified story, told carefully because the details are the lesson. In October 2025, Deloitte Australia partially refunded the Australian government over a A$439,000 report after a Sydney University academic flagged fabricated references and a misattributed Federal Court quote. Deloitte attributed the errors to generative AI use it later disclosed - the revised report named Azure OpenAI GPT-4o. The refund was roughly A$97,000, the contract's final installment. Note the careful phrasing: Deloitte never said the whole report was AI-written, and nobody claimed the strategy was wrong.

LiveWhat it actually cost, and the rail it implies5 min▶

What the incident cost was not the refund - A$97,000 is a rounding error for a big-four firm. It was the headline: a global brand attached, in public, to fabricated citations in government work. Every procurement officer who read that story now asks every consulting firm the same question, and your firm needs a better answer than "we tell people to be careful."

The rail: a named human owns every citation, quote, and number that reaches a client. AI-supplied facts are leads until source-verified - a lead is useful, a lead in a deliverable is a liability.

And the disclosure half is becoming structural: disclosure clauses in client and government contracts - stating whether and how generative AI was used - are the emerging norm. Deciding your firm's disclosure posture BEFORE a client asks is Part 3's section four; deciding it after they ask is called an apology.

Real worldRun the counterfactual: same report, same AI use, but a citation audit before delivery catches the fabricated references and the misattributed quote. Cost of the audit: hours of a senior reviewer's time against a A$439,000 engagement. Instead the check was performed, for free, by an outside academic - which is the most expensive QA arrangement ever devised. The verification duty in your policy is that audit, moved inside the building.
Self-studyRetelling the incident accurately2 min▶

Precision matters when you retell this story to your partners, because the exaggerated version is easier to dismiss. Deloitte never said the whole report was AI-written; it attributed specific errors to generative AI use it later disclosed, and the revised report named the tool. The strategy was not the finding at issue; the production details were. Told that way, the story is not "AI wrote a bad report" - it is "fluent, unverified production details survived every internal read and a client-side academic caught them." That version is harder to wave off, because every practice ships production details every week.

Part 3 · covers the policy anatomy

Policy anatomy: the one-page version 6 min live

Two incidents, two rails, five sections. This anatomy is field practice - the shape we see working, labeled honestly as such, not a regulation or an official standard. What makes it work is not the sections; it is that it fits on one page, names owners, and applies to everyone including the partner who bills the most.

LiveThe five sections every firm AI policy needs4 min▶
#SectionWhat it saysWhich incident it answers
1Approved tools by tierNamed tools, named versions, which tier - and who approves additionsSamsung: "permitted" must mean a specific contract, not a category
2Data rulesClient-identifying material anonymized even in approved tools; forbidden categories listed explicitlySamsung: the behavioral layer on top of the contractual one
3Verification dutyWho owns facts - a role, not a person - and the citation-audit gate before anything shipsDeloitte: a lead is not a fact until a human saw its source
4Disclosure postureWhat clients are told about AI use, and when - decided before they askDeloitte: disclosure arrived in the revised report, after the headline
5Incident pathWho to call, no-blame reporting, response stepsSamsung: employees hid nothing, the tool permitted everything - reporting must be safe

And the leader's clause that makes the other five real: no exceptions for rainmakers. The first time a top biller gets a pass on the data rules, the policy converts from a rail into a suggestion - and everyone watching knows it.

1 Approved tools by tier Named and versioned; consumer vs enterprise stated; one owner approves additions 2 Data rules Client-identifying material anonymized even in approved tools; forbidden categories listed 3 Verification duty A named role owns every fact; the citation-audit gate runs before anything ships 4 Disclosure posture What clients are told about AI use, and when - decided before they ask, not after 5 Incident path Who to call, no-blame reporting - Samsung's staff hid nothing; reporting must be safe One page, named owners, no exceptions for rainmakers - or it is a suggestion, not a policy.
🔍 Click to zoom - the one-page policy, five sections top to bottom
Self-studyWhere the rails get drilled into hands2 min▶

Policy on paper is half the system; reflexes are the other half, and those live in the consultant track. Session b3 builds the research discipline that treats AI-supplied facts as leads. Session b8 runs the confidentiality drill against a live gate: a draft that scores 87 on prose quality alone gets capped at 15 the instant client-identifying material appears in it, and the alarm lists the leaks. If you lead a practice, have your consultants run both - a team that has watched the gate slam once writes section 2 into its own muscle memory.

Everyone works

Draft or audit your policy 📋 ★ 18 min · everyone works

No lab widget on the leader track - your firm's policy is the exercise. If you have one, audit it; if you do not, a blank page and eighteen minutes produces a better draft than most firms currently run on.

Get your firm's policy in front of you - or a blank page titled with today's date. Independents: your policy is one page for an audience of one, and you need it most, because no risk team is coming.

Check it against the five sections. Approved tools by tier, data rules, verification duty, disclosure posture, incident path. Mark each: present, vague, or missing. "We use AI responsibly" counts as missing.

Write the forbidden-data list for YOUR practice. Client names? Deal terms? Personal data? Board material? Be concrete - a list your newest analyst could apply at 11pm without asking anyone.

Write the verification-duty sentence, naming a role, not a person. "The engagement manager owns every citation in the readout" survives staffing changes; "Sarah checks the facts" does not.

Decide the disclosure posture in one sentence. What do clients get told about AI use, and when? Write the sentence you would be comfortable seeing quoted back to you in a procurement meeting.

Note the single biggest gap and who owns closing it. One gap, one name, one date. A policy audit that ends without an owner is a reading exercise.

✦ If you finish early Retell one of today's two incidents, out loud, from memory - dates, numbers, what it cost. If you can tell the story, you can defend the policy to the partner who thinks it slows him down.
Before next session

Homework 📝 ◐ 25 minutes

Check yourself

Three questions before you go 🎯 ◐ 90 seconds

1 · The clean rule shape for AI tool tiers and training is...

Consumer = behavioral opt-out someone must remember to flip (including Anthropic's consumer tiers since the September 2025 terms). Enterprise/API = contractual no-training by default, per the vendors' own pages. You anonymize anyway - the behavioral layer sits on top of both lanes.

2 · What actually cost Deloitte Australia in October 2025 was...

Nobody claimed the strategy was wrong, and the refund was the contract's final installment - modest money. Fabricated citations in a government report, flagged by an outside academic, made the news. The rail: a named human owns every citation, quote, and number that ships.

3 · The five sections of the one-page firm AI policy are...

Two per rail plus the response plan: tools and data rules answer Samsung, verification and disclosure answer Deloitte, and the incident path answers both - with no-blame reporting, because Samsung's employees hid nothing and the tool permitted everything.

Coverage, honestly

What this session covered from the official universe

✓Samsung 2023 incident (Forbes, Bloomberg)permitted March 11, 2023; three leaks in ~20 days (source code x2, meeting transcript); May 2023 device ban
✓Deloitte Australia 2025 incident (CFO Dive, OECD.AI)told with the careful phrasing: errors Deloitte attributed to generative AI use it later disclosed; ~A$97k of A$439k refunded
✓Vendor data-handling terms (OpenAI enterprise privacy; Anthropic commercial + consumer terms)the consumer-vs-enterprise training rail, stated as the vendors state it
✓Policy anatomy (five sections)field practice, labeled honestly - the shape that works, not a regulation or official standard

Certificates, videos, and graded assessments stay with the official providers - this course teaches the working core.

Leader session 3 cheat sheet

Incident oneSamsung permitted ChatGPT March 11, 2023; ~20 days, 3 leaks (source code x2, meeting transcript); May 2023 company-wide genAI ban on work devices.
The translationSamsung leaked its own material. A firm leaks the CLIENT's - and trust is the product it sells.
Rail 1 rule shapeConsumer tiers may train unless opted out (Anthropic consumer too, since Sept 2025); commercial/enterprise/API tiers do not train by default. Anonymize anyway.
Incident twoDeloitte Australia, Oct 2025: A$439k government report; academic flagged fabricated references + misattributed Federal Court quote; ~A$97k refund; Azure OpenAI GPT-4o disclosed in the revised report.
Rail 2A named human owns every citation, quote, and number that reaches a client. AI-supplied facts are leads until source-verified. The cost was the headline, not the refund.
The five sectionsApproved tools by tier · data rules · verification duty · disclosure posture · incident path. One page, or nobody reads it.
The leader's clauseNo exceptions for rainmakers. One pass for a top biller converts the policy into a suggestion.
Hands vs policyThe consultant track drills the rails (b3 research discipline, b8 gate caps an 87 draft at 15). The leader funds the tooling and holds the line.