learn-prompt-engineering-with-phoebe / Leader session 3 of 6
Learn Prompt Engineering with Phoebe · Leader track · Session 3 of 6

AI as thought partner

Sessions 1 and 2 taught you to hand AI tasks. This one is different: using it to think - wider brainstorms, honest critique of your own drafts, and premortems on real decisions. The catch: by default it agrees with you, and flattery is worthless. Today you learn to make it push back.

🟡 Leader track C-level, boards & managers No tech required Bring one real decision 30 min self-read · 45 min live
0-3 · Welcome 3-25 · Thinking together 25-40 · The premortem, live 40-45 · Q&A
Part 0

From tasks to thinking

The Meridian exec team can now write a proper brief - Dana gets her themed summaries, the CMO has her campaign template. But the highest-value use of AI for a senior leader is rarely another task. It is a thinking partner that never tires, never worries about your reaction, and holds more patterns than any advisor - if you know how to stop it from simply telling you that you are right. Dana has a real decision on the table this month, and we will use it.

Live - presented in session Self-study - read after class ★ Try it in your next sitting Any model · any chat app
★ What you walk out with today Three thought-partner moves you can run this week - the wide brainstorm, the tough reviewer, and the premortem - the antidote to the sycophancy trap that quietly ruins most executive AI use, and a plain-language map of when to rely on what the model knows, when to make it search, when to send it researching, and when to hand a hard trade-off to a reasoning model. Plus a live premortem on a decision you actually face.
Part 1 · the moves

Beyond tasks: thinking together 8 min live

Andrew Ng's non-technical prompting course devotes a whole module to this shift: from AI as a doer of tasks to AI as a partner in reasoning. Three moves cover most of what a leader needs - and each one has a trick that separates a useful session from a pleasant waste of ten minutes.

LiveMove 1 · the wide brainstorm - ask for 20, not 33 min▶

Ask for "some ideas" and you get the five most obvious ones - the same five your team already said in the meeting. The fix is volume plus variety rules:

  • Demand quantity. "Give me 20 options" forces it past the obvious. Ideas 1-5 are the meeting; ideas 12-20 are where the interesting ones hide.
  • Ask for the unusual explicitly. "Include at least 5 that a conventional retailer would never consider." It will not volunteer weird - you have to license it.
  • Force distinct angles. "No two options from the same category" or "vary who pays, who benefits, and what we would stop doing." Variety rules prevent 20 flavours of the same idea.
Real world

The CMO's loyalty brainstorm. Asked for "ideas to improve our loyalty programme" she got points, tiers, and birthday vouchers - a 2015 conference talk. Asked for "20 options, at least 5 unconventional, no two from the same category, and for each say what we would stop doing to fund it" she got two ideas that made the next exec agenda. Same tool, ten minutes apart.

LiveMove 2 · the tough reviewer - point it at your own draft3 min▶

Most people use AI to write drafts. The more senior you are, the more value runs the other way: you write the draft, and AI critiques it before a human ever sees it. The trick is casting - do not ask "is this good?", assign a hostile role:

  • "You are a skeptical board member who has seen ten transformation plans fail. Find the 3 weakest claims in this paper and say why each would make you vote no."
  • "You are our toughest competitor's strategy head. Where would you attack this plan?"
  • "Read this as the store managers will read it. What lands badly, and what question will every one of them ask that I have not answered?"

A tough review costs you nothing but pride, arrives in a minute, and no career is harmed in the making. The board sees draft four, not draft one.

Self-studyMove 3 · the premortem - failure, explained in advance3 min read▶

The premortem is a decision-science classic: instead of asking "what could go wrong?" (which invites polite shrugs), you declare the failure already happened and ask for the story. "It is 12 months later and this initiative failed - write the post-mortem." The tense change unlocks specifics, because explaining a fact is easier than imagining a risk.

AI is unreasonably good at premortems. It has absorbed thousands of retail case studies, failed rollouts, and post-mortems, and it has no stake in your project being a good idea. It will name the awkward failure modes - the ones involving your own org chart - that nobody says in the room. The live exercise today is exactly this, on a real decision. You will see the template in the workshop section.

Part 2 · the trap

The sycophancy trap 7 min live

Here is the uncomfortable fact behind all three moves: by default, models tend to agree with you. They are trained on human feedback, and humans reward agreeable answers. Show it your plan and it will find the good in it - every time, regardless of the plan. For a junior analyst that is annoying. For an executive whose staff already hesitate to disagree, it is a second yes-man, at scale.

The sycophancy loop - feels great The fixed loop - feels spiky, works You propose It agrees Confidence up Quality flat You propose It attacks You strengthen Same tool, opposite loops. The difference is one sentence you must say out loud: "argue against this."
🔍 Click to zoom - the sycophancy loop vs the fixed loop: agreement flatters, requested pushback strengthens
LiveEscaping the loop - the sentences that buy honesty4 min▶

You cannot make a model less agreeable by wishing. You make it honest by making disagreement the assignment:

Instead of...Say...
"What do you think of my plan?""Argue against this plan. Steelman the case for NOT doing it."
"Is this analysis right?""What would a skeptical CFO say about this analysis? Be specific about the numbers."
"Any feedback on the draft?""Give me the 3 weakest points and the strongest objection I have not answered. No compliments."
"Do you agree?""Under what conditions would this be wrong? What evidence would change the recommendation?"
The house rule Never let AI just validate a decision you have already made. If every AI conversation about your plan ends with you feeling better and the plan unchanged, you are in the left loop - burning time to purchase confidence. Requested pushback is the price of a partner instead of a mirror.
Self-studyWhy models flatter - and why it is partly your fault2 min read▶

Sycophancy is not a bug someone forgot to fix. Models are tuned on human preferences, and humans consistently rate agreeable, encouraging answers higher - so agreement gets trained in. Worse, your phrasing leaks your preference: "I'm thinking we should go ahead with the pilot - thoughts?" tells the model which answer will please you, and it obliges. Ng's course flags this as THE trap for non-technical users precisely because senior people are the least likely to get pushback from humans either.

Two habits blunt it. First, hide your position when you want a clean read: present the options as A and B without revealing your favourite. Second, make pushback structural: end big asks with "list the strongest arguments against your own recommendation." The model does both happily - it just will not start.

Part 3 · the gears

Knowing vs searching vs reasoning 7 min live

A thought partner is only as good as what it is thinking WITH. Modern AI chat apps have four distinct gears, and executives who mix them up get burned: trained knowledge with a cutoff date, live web search, deep research that reads dozens of sources for you, and reasoning models that plan before answering. Knowing which gear you are in is a 30-second check that prevents most embarrassments.

1 · It knows Trained knowledge. Vast, instant - and frozen at a cutoff date. 2 · It searches Web search grounds answers in today, with sources you can open. 3 · It researches Deep research reads dozens of sources and writes a cited report. 4 · It reasons Reasoning models plan before answering - built for hard trade-offs. For gear 4, state the goal and the bar for a good answer - then let it pick the method. Do not dictate the steps.
🔍 Click to zoom - the four gears: know, search, research, reason
LiveWhich gear, when - the reach-for table4 min▶
You need...Reach forWatch out
Concepts, frameworks, drafting, timeless how-toTrained knowledgeAnything dated may be stale - it cannot know past its cutoff, and it may not warn you
Today's facts: prices, people in roles, this week's newsWeb searchSkim the sources it cites; search grounds the answer, it does not guarantee the reading
A market scan, vendor comparison, competitor landscapeDeep researchTakes minutes, not seconds; check the source list before you trust the synthesis
A hard trade-off, a plan with many moving partsReasoning modelState the goal and the bar, not the method - micro-managing its steps makes it worse
Real world

Dana's gear check. Planning the fulfilment decision, Dana used all four in one afternoon: trained knowledge to explain ship-from-store models, web search for what competitors announced this quarter, deep research for a cited report on rollout economics, and a reasoning model for the staffing trade-off across 20 stores. Four gears, one decision, no confusion about which answer came from where.

Self-studyThe reasoning-model habit, one level deeper2 min read▶

Session 1 planted the habit: with reasoning models, state the goal and the bar, do not dictate method. Here is the why. These models are trained to plan internally - they draft an approach, check it, and revise before you see a word. Prescribing your own step-by-step method overrides a planner that is usually better at planning than your prompt is. Every major vendor now says the same thing in their guidance.

What replaces the method? The bar. "A good answer will compare at least three options, quantify the staffing impact, and tell me what would have to be true for the cheapest option to win." You define done; it finds the route. If that sounds like how you delegate to your best director, that is the point - and the full technical story lives in Builder session 4.

The boardroom moment

The premortem: one real decision, stress-tested ★ 15 min · work it live

You brought one real decision. Dana brought hers: whether Meridian should launch ship-from-store fulfilment in 20 stores this autumn. We run her premortem together, then you run yours. This is the tough-reviewer move and the sycophancy antidote in one exercise.

The premortem prompt - steal this templateYou are a seasoned retail operator with no stake in being nice to me. Context: Meridian Retail (2,000 people, 80 stores, an online arm) is deciding whether to launch ship-from-store fulfilment in 20 stores this autumn. The one-page plan is pasted below the ===. It is 12 months later and the initiative failed. Write the 5 most likely post-mortem findings. For each finding: 1. What went wrong, in one sentence 2. The early warning sign we probably ignored 3. What we could do THIS month to prevent it Then tell me which single finding you would bet on, and why. Do not reassure me. If the plan has a fatal flaw, lead with it. === [paste the one-page plan here]

Pick a live decision. Real and undecided - a pilot, a hire, a vendor, a reorg. The premortem only bites when you still have time to act on what it finds.

Write the one-paragraph brief. What you are deciding, the scale, the timeline, what success looks like. Session 2 discipline: the premortem is only as sharp as the context you give it.

Run the premortem prompt. Use the template above. Read the five findings and mark the one that made you wince - the wince is data.

Add the skeptical CFO pass. Follow up with: "Now, what would a skeptical CFO say about the financial case? Attack the numbers specifically." Different role, different failure modes - roles are lenses.

Harvest one action. Pick the most plausible early warning sign and give it an owner and a date this week. A premortem that changes nothing was a séance, not a meeting.

Make it a ritual, not a rescue The premortem works best BEFORE you are in love with the plan. Dana now runs one on every proposal above a spend threshold, before the exec discussion - ten minutes, standing agenda item. The AI never gets tired of being the pessimist, and no human has to volunteer for the job.
Homework

Three things before session 4 ◐ 25 min total

Source material

What this session covers

Leader-level coverage of the sources below - working ideas in plain language, honestly flagged where the depth lives in the builder track. Official certificates and videos stay with the vendors; links are in the course map.

✓Andrew Ng - AI Prompting for Everyone, Module 2: brainstorm + critiquePart 1 · wide brainstorms, tough reviewer, premortems (DeepLearning.AI)
✓Ng Module 2 - the sycophancy trap and asking for pushbackPart 2 · the loop diagram and the honesty sentences
✓Reasoning models for non-technical users - goal and bar, not methodPart 3 · the habit, with the why (all major vendors now agree)
◐Ng Module 1 - web search and deep researchPart 3 · working overview and the gear table; hands-on labs stay with DeepLearning.AI
◐Reasoning-model prompting in depthBuilder session 4 tells the full technical story, from chain-of-thought to effort levels
Check yourself

Three questions before you go 🎯 ◐ 90 seconds

1 · Every time you share a plan, the AI tells you it is strong and well-considered. The best fix is to...

Models are tuned toward agreeable answers, and your phrasing leaks your preference. Ratings get inflated and model-switching does not remove the training. Making disagreement the assignment does.

2 · You need a competitor's current market position and this quarter's announcements. You should...

Trained knowledge is frozen at a cutoff date, and no phrasing can update it. Current facts need the search or research gear - and the sources are there to be opened, not admired.

3 · You hand a reasoning model a hard staffing trade-off. The best brief...

Reasoning models plan internally, and every major vendor now warns that dictating the method degrades them. You define done - the bar - and it finds the route. Delegation, again.

Leader session 3 cheat sheet · pin this

Ask for 20, not 3Volume forces it past the obvious. License the unusual explicitly - it will not volunteer weird.
Force distinct angles"No two options from the same category." Variety rules prevent 20 flavours of one idea.
The tough reviewerCast a hostile role at your own draft: skeptical board member, competitor, store manager. Draft four goes out.
The premortem"It is 12 months later and this failed - write the post-mortem." Then harvest one owned action.
The sycophancy trapDefault is agreement. Never let it just validate - if you only feel better, you got a mirror, not a partner.
Hide your favouritePresent options as A and B without revealing your lean. Your phrasing leaks; a clean read needs a poker face.
Four gearsKnow (cutoff!), search (today + sources), research (dozens of sources, cited), reason (hard trade-offs).
Goal and bar, not methodWith reasoning models, define what a good answer must include - and let it plan the route.