learn-asking-right-questions-as-de-with-phoebe / Session 5 of 6
Learn Asking the Right Questions as a Data Engineer with Phoebe · Session 5 of 6

Three projects, starting with one real copy

You walked out of the meeting with a page of her answers: a two percent gap every month and an auditor who has asked about it in writing, 38 CSV files pasted by hand every Monday, three stock spreadsheets, product codes that differ by country, one admin login that is about to leave. That page is not a project. Left alone it becomes the thing an engineer reaches for first, a pipeline that pulls every system into one place, and a pipeline built on copies nobody has declared real moves the disagreement faster instead of settling it. Tonight turns the answers into a tree with her test at the top, prunes the tree to three candidate projects that each begin by declaring one copy real, scores them with a rule written where she can argue with it, and shapes the winner into a pilot small enough to start on Monday with no budget. Doors 1 and 6, outcome and success, choose; door 4, data state, decides what each candidate has to settle first. The corridor of six is in the shared session 1.

🟡 Core Data engineers, and anyone asked to "connect the systems" No code. A pen. 45 min
0-3 · Welcome 3-18 · The tree, the three, the pilot 18-40 · Build-along: your tree, your three, your first copy 40-45 · Q&A
Part 0

Where we start

Sessions 1 to 4 were about getting facts out of a person who did not know she had them. Adeline Tan, operations director of Harbourline, a constructed chain of 38 pharmacy and clinic outlets in Singapore and Malaysia, opened with "Our numbers never match. Finance says one thing, the POS says another." On session 3's bench the order tuned for an engineer got 17 of her 24 facts in 45 minutes. The danger now is the opposite of the first meeting's. Then, you had too little; now you have a page of pains and a strong pull toward the one you know how to build. For an engineer that pull has a name, "connect the systems", and it is the exact request that stalled at Harbourline two years ago. The move tonight is to let her test choose, to make every candidate say which copy it treats as real before it moves a single row, and to write the choosing down so she can see it and disagree.

🎫 Clear all three quiz questions to stamp your passport Live = presented in the 45 minutes Self-study = the full depth, after class ★ Build-along = write it yourself

★ What you walk out with tonight. One page for a request you actually hold: her test in her words at the top of a tree, the pains she named as its branches, three candidate projects written in six lines each (what, first step, who, needs, which copy is declared real, whose login it runs on), a scoring grid with the combination rule written above it, and a five-line pilot with a scope, a partner, a test and a date. Session 6 folds that page into the brief you send her within 24 hours.

Part 1 · covers her answers as a tree

Her test on top, the copies underneath

5 min live

Teresa Torres's opportunity solution tree, reported here from her 2021 book, has four layers: a desired outcome at the top, the opportunities underneath it, solutions under the opportunities, and assumption tests under the solutions. An opportunity is a pain the customer voiced; a solution is a thing you could build; the outcome is what would be different if the pain went away. Adeline's meeting gave you all three layers in her words and in the wrong order, and the engineer's habit makes the order worse, because the solution layer is the one you think in. The tree puts her test back on top, where every pipeline, script and page underneath can be checked against it.

HER TEST ON TOP, THE PAINS UNDER IT outcome in her words · pains as she said them · things to build come last Adeline OUTCOME, in her words "the auditor stops asking, and Priya's Monday takes one hour instead of six" OPPORTUNITIES: THE PAINS SHE NAMED two percent gap each month; the auditor wrote finance books its own number, argues after 38 CSVs pasted by hand, six hours a Monday silent fixes by hand, and no record of them three stock sheets, one on Priya's laptop product codes differ between SG and MY SOLUTIONS, MORE THAN ONE, UNDER THE STRONGEST a written bridge each timing gap named a nightly pipeline POS and ledger, one table a reconciliation tool bought from Q1's budget upside-down tree: "a pipeline" on top Every box is something she said. The engineer added only the order, and the order is the argument.
🔍 Click to zoom - the teal box came out of door 6, the hatched row is her pains as she said them, and the white boxes are the only layer you are allowed to invent
LiveHer test, in her words2 min▶

The top box is her answer to "how will you know this worked?", and it is written in her words, not yours: the auditor stops asking, and Priya's Monday takes one hour instead of six. Two things she can see without opening anything you built. A pipeline is not on it, and neither is a warehouse, a single source of truth or a daily refresh, because she never said any of those was the point.

Test the top box by turning the tree over. If what sits at the top is "a pipeline" or "connect the systems", the tree is upside down: a solution is pretending to be an outcome, and every branch under it will be a feature of the pipeline, sources, schedules, tables, rather than a pain of hers. That is the tree that produced the vendor integration project two years ago, which stalled the week Kenneth went on leave and never restarted. An outcome box you can check a build against reads like a fact about her office in eight weeks: a letter that stopped coming, a Monday that got its afternoon back.

Keeping her words is not politeness. "The auditor stops asking" is the sentence her board and her auditor already understand, so a project that points at it is one she can defend upward without translating. The moment you rewrite it as "improve data consistency across systems", it is your project again, and she cannot tell whether it worked.

LivePains she named, not diagnoses2 min▶

The second row is a transcript, not a brainstorm. Each box is a pain she voiced behind doors 1 to 4: finance and the POS differ by about two percent every month and the auditor has asked why in writing; at month-end finance books its own number and argues afterwards; Priya downloads 38 CSV files every Monday and a 2019 macro merges them, six hours; when a number is wrong Priya fixes it by hand and nobody is told; three versions of the stock spreadsheet are in circulation and the one Priya treats as real is on her laptop; product codes differ between the Singapore and Malaysia outlets. Six boxes, six things she said.

The discipline is to write nothing in this row she did not say. "No single source of truth" is your diagnosis; "three stock sheets, one on Priya's laptop" is her pain. The first is a solution wearing a problem's clothes, and it pulls a warehouse in behind it. Torres's rule, as reported, is that opportunities are framed from the customer's side, and the reason is practical: a pain in her words is one she recognises on the page and fights for, and a diagnosis in yours is one she nods at.

Which opportunity is strongest is the first real judgement on the page, and it is a judgement about her test, not about the data. The two percent gap earns the thick edge because half of her test, the auditor, is decided by whether anyone can say in writing why the two numbers differ. The 38 CSVs are the other half, and they come second in the tree for a reason Part 2 makes plain.

Self-studySolutions come last, and the pipeline is only one of them2 min▶

Solutions are the only layer you invent, and the rule is at least two per opportunity you take seriously. Under the two percent gap: a written bridge that names each timing gap, card settlements two days late, cash deposited weekly, refunds that exist only in the accounting system; a nightly pipeline that loads the POS and the ledger into one table; a reconciliation tool bought once the SGD 15,000 opens in Q1. Three shapes, from cheapest to dearest. Writing three stops the first one you thought of, for most engineers the pipeline, from becoming the plan because it was alone on the page.

Torres's fourth layer, assumption tests, is where the pipeline shows its problem. The assumption under "POS and ledger in one table" is that the two copies are measuring the same thing on the same day, and her own answer says they are not: the gap is mostly timing, with refunds that the POS never sees. The pipeline would faithfully deliver the two percent every morning instead of once a month. The assumption under the written bridge is that three named timing gaps account for most of the difference; the test is to write the bridge for four outlets from last month's export and see what is left over. The Product Thinking course teaches the tree as a discipline; here it is borrowed for one job, ordering what she already told you.

Real world

The pipeline that delivered the gap every morning. A constructed case, but the shape is the common one. An engineer takes "our numbers never match" as a request to connect the systems and builds exactly that: POS sales and ledger revenue side by side in one table, refreshed nightly, with a variance column. It works on day one. By day three the operations director has a report that shows a difference every single day, larger early in the week and smaller after the weekly cash deposit, and nobody in the room can say which side is right, because nothing in the build ever declared which copy was the one to book. The disagreement used to arrive monthly. Now it arrives with breakfast. Nothing in that tree pointed at the auditor's letter, so nothing in the build could answer it.

Part 2 · covers pruning and scoring

Three candidates, each starting with one real copy

5 min live

A tree with six branches is a map, not a plan. The prune is to three candidate projects, one under each of the three strongest opportunities, never three solutions to the same one. At Harbourline: declare one stock sheet real and retire the other two; replace Priya's 38 manual downloads with one scheduled export built from what exists, run by Priya and documented, with the vendor API evaluated second, not first; and a written month-end reconciliation that states the timing gap so finance and the POS agree on why they differ before anything is automated. Two rules sit over all three. No new tool before a copy is declared real. Nothing that depends on Kenneth's login after January.

THREE CANDIDATES, ONE GRID, THE RULE WRITTEN ABOVE IT RULE, written first: impact x confidence x ease, 1 to 10 each. We multiply. CANDIDATE IMPACT CONFIDENCE EASE I x C x E 1 One stock sheet declared real, the other two retired 4 8 9 288 2 One scheduled export, run by Priya, documented; the vendor API evaluated second 9 5 7 315 3 A written month-end bridge that states the timing gap 9 8 7 504 winner argues with the digits The digits are the engineer's judgement, written down so she can argue with them. Averaged: 7.0, 7.0 and 8.0. The same winner, but rows 1 and 2 tie; multiplying splits them, 288 against 315.
🔍 Click to zoom - the rule sits above the grid because a score whose rule is unwritten cannot be argued with, only accepted
LiveFrom tree to three, each with a declared copy2 min▶

Pruning has one rule: one candidate under each of the three strongest opportunities, never three solutions to one. Three ways to reconcile the revenue is a menu, and a menu makes her choose a build. Three projects under three different pains is a portfolio, and a portfolio lets her choose a problem, which is the choice she is qualified to make.

An engineer's candidate is written in six lines, two more than most: what it is, in words from her tree; the first step, something that can start this week; who does it, a named person on her side and on yours; what it needs; which copy it declares real; and whose login it runs on. The fifth line is the one that stops a pipeline moving the disagreement faster. Candidate 1 declares one of the three stock sheets real, and it is her decision, not Priya's laptop's. Candidate 2 declares the POS export the copy the Monday report is built from, with every hand fix Priya makes written down beside it, because a silent fix is a second source of truth. Candidate 3 declares which revenue number is booked at month-end, which today is finance's, and writes down why the POS differs from it.

The sixth line is the fact that only comes out once she trusts you, a gate of 3 on session 3's bench. Kenneth is the only IT person, holds the only POS admin login, and leaves in January. So candidate 2 runs on Priya's own access, the way she downloads the 38 files today, and the vendor API waits until someone other than Kenneth can say yes to it. Whether the POS lets an ordinary login schedule its export is not on her sheet. It is the assumption the first step tests, and until it is tested, confidence on row 2 is a 5.

LiveScore it, and write the rule down2 min▶

Sean Ellis and Morgan Brown's ICE score, reported here from Hacking Growth, rates each candidate on impact, confidence and ease, each from 1 to 10. How the three are combined is contested: some teams multiply, some average, and the summaries that quote the book describe it differently. So the honest move is not to pick the right rule. It is to write down which one you used, above the grid, before you fill in a digit.

The grid above shows why. Multiplied, the three rows score 288, 315 and 504. Averaged, they score 7.0, 7.0 and 8.0. The winner is the same, but the order below it is not: averaging ties the stock sheet with the export, and multiplying puts the export ahead, because its one weak leg, a confidence of 5, is outweighed by an impact of 9 that speaks straight to Priya's six hours. Multiplying punishes a weak leg harder than averaging does; averaging forgives it. Neither is wrong. An unwritten rule is.

The digits are yours, and that is the point rather than a weakness. "Why is impact only 4 on the stock sheet?" is a conversation about her office, and the honest answer is that stock is not in her test; she did not mention it when asked how she would know this worked. A grid with the rule above it is a page she can argue with. A ranking with no rule and no digits is a verdict, and a verdict she did not make is one she will not defend to the auditor.

Self-studyThe simple fix first, and the API second1 min▶

Google's machine learning problem-framing course, read at source, gives one line that belongs on every engineer's prioritisation grid: verify that the current non-ML solution is optimized before you build anything cleverer. The course is about models, and the line is about pipelines too. At Harbourline the clever thing is an integration through the vendor API, which nobody has ever used. The current solution is Priya's 38 downloads and a 2019 macro, and it is not optimized; it is a person doing by hand what one scheduled export could do. Fix the current way first and the API becomes a second step with a known baseline. Start with the API and you are building on a login that leaves in January.

The same logic puts the written bridge first. Card settlements landing two days late, cash deposited weekly and refunds that live only in accounting are not a data problem any tool will fix; they are three sentences that belong on a page before any job runs. The Decision Intelligence course owns the wider discipline of choosing between options under uncertainty; the grid here is a single page of it.

Real world

The API that was evaluated first. A constructed case, built from her own answers. Two years ago a vendor integration project at Harbourline stalled the week Kenneth went on leave and never restarted. An engineer who puts the vendor API first in tonight's plan puts the same dependency first again: the one person with the admin login, now leaving in January. The API may well be the right answer in Q1, when there is budget and, with luck, a second person who can log in. It is the wrong first step, because the first step has to survive the person who is not in the room, and the winner on the grid needs no admin login at all: it is written on a page, from the one export a month the bookkeeper already sends.

Part 3 · covers the pilot

Four outlets, eight weeks, one written answer

4 min live

Door 6 is where a candidate becomes a pilot, and everything the pilot needs was in her answers. Her test: the auditor stops asking, and Priya's Monday takes one hour instead of six. Her partner: Priya, two hours a week, and Priya wants to learn. Her scope: four outlets first, never all 38 at once. Her constraint: no budget this quarter, SGD 15,000 in Q1, so the first step uses what exists. Her dates: the board in six weeks, the auditor's written answer in eight. Facts from doors 5 and 6, and the pilot almost writes itself.

EIGHT WEEKS, FOUR OUTLETS, ONE WRITTEN ANSWER the constructed timeline for the winner, then the export's first step · nothing spent before Q1 0 1 3 5 6 8 WEEK the brief one page, sent within 24 hours the bridge drafted last month's export, four outlets, Priya first month-end closed with the bridge by day five Priya's export on her own login; Monday: one hour the board meets one slide: the four outlets' bridge auditor's answer written, week 8, the bridge attached the test the auditor stops asking Nothing on the line costs money: the bridge is a written page, and the export uses the access Priya has today. The month-end is drawn at week 3 for the picture; where it really falls depends on the meeting date.
🔍 Click to zoom - the answer is teal because it is the only thing on the line with a name and a date she did not choose, and the letter above the line is how she will know
LiveThe pilot is the first step, not the plan2 min▶

A pilot is the winning candidate with four things pinned to it: a scope, a partner, a test and a date. All four came out of doors 5 and 6, so none of them is yours to invent. Scope: four outlets, because she said she would run a pilot in four first, never all 38. Partner: Priya, two hours a week. Test: the auditor's written answer, due in eight weeks, and a Monday that takes one hour. Budget: nothing before Q1.

The pilot runs the winner first and the runner-up's first step second, because the order is the argument. The bridge comes first: for four outlets, from last month's export, the three timing gaps written as sentences, card settlements two days behind the till, cash banked weekly, refunds that only the accounting system sees, and whatever is left over written as "not yet explained". Only when finance and the POS agree on why they differ does anything get automated, and the first thing automated is small: Priya's own export for the same four outlets, on her own login, with every hand fix written down. A pipeline built before the bridge moves the disagreement faster; a pipeline built after it carries a number both sides have already agreed to disagree about, in writing.

Four outlets beat 38 for a reason she can feel and you can measure. In four outlets the bridge is a page Priya can check line by line against the till receipts; across 38 it is a report nobody reads to the bottom. And her test beats a pipeline metric because the pipeline metric measures the build: a job that ran every night for eight weeks and an auditor who is still asking is a failed project with a green dashboard.

Self-studyWhat the tuned meeting did not hear2 min▶

Run session 3's bench on the order tuned for an engineer and read the log to the end, not just the total. The data-state door opened widest gets her test and her four-outlet scope from "How will you know this worked?", and it gets Kenneth's login, the monthly export limit and the three stock sheets. Then it runs out of minutes on the limits question, before "When is the next date you have to show something upward?" and "Who on your side could spend two hours a week with me?" are ever asked. So the tuned 45 minutes never hear the board in six weeks, the auditor's answer due in eight, or Priya's two hours.

The printed door order has the mirror-image gap: it hears the dates and Priya's two hours, and misses her test, the four outlets and Kenneth. Neither order hears everything, which is the honest state of any 45-minute meeting. The pilot above uses facts from both, and the ones your own meeting did not reach are not facts yet. On your page they are marked as guesses to confirm, and session 6 puts them in the covering note as the two questions you did not get to.

Self-studyKenneth's login shapes the plan and never appears in it1 min▶

She told you Kenneth is leaving in January, and she told you she has not told the team. That fact decides the plan without being written into it. Every step in the eight weeks runs on access someone other than Kenneth holds: the bookkeeper's monthly export, Priya's own downloads, a page. Nothing waits for the admin login, and nothing needs it after January. The vendor API goes on the Q1 list with one line beside it, "needs an admin login we can keep", which is true whoever holds it.

The discipline is to use a confidence without spending it. Priya is your partner and will read the brief; a line that names Kenneth's departure is a line Adeline did not agree to publish. Design around the fact, keep it in your own notes, and let the brief say only what the plan needs: no step depends on one person's login.

Real world

The answer the auditor asked for again. A constructed case, with a shape that recurs. The four-outlet bridge went to the auditor in week 8 as a single page: the two numbers, three named timing gaps with the amount each explained, and one short line marked "not yet explained". The auditor did not ask which number was right. He asked for the same page for all 38 outlets at the next month-end. That is the difference between a pilot and a demo: a demo is shown, a pilot is asked for again, and the request to scale came from the person whose letter started the meeting.

Build-along

Your tree, your three, your first copy

★ 22 min · everyone writes

One page, three columns. Take the answers you collected for your real request, or Adeline's if you have none yet, and build the page in six steps: the test in their words, the pains as they said them, solutions and an assumption under the strongest, three candidates with a declared copy and a login each, the grid with its rule, and the pilot. Every line is written tonight; nothing on the page is a decision the business person has not already given you the facts for, and every line they did not give you is marked as a guess.

THE PAGE, THREE COLUMNS, LEFT TO RIGHT 1 TREE test, in their words pain pain pain two solutions under each, one assumption under each 2 THREE CANDIDATES what · first step who · needs real copy · whose login what · first step who · needs real copy · whose login what · first step who · needs real copy · whose login I C E rule 3 PILOT scope: four outlets partner: Priya, 2 h a week test: the auditor's answer and a one-hour Monday date: week 8, board week 6 needs: nothing before Q1 login: none of Kenneth's Left to right, as the meeting ran: her test picks the pains, the pains pick the three, the rule picks the one.
🔍 Click to zoom - the pilot is teal because every line in it traces back to a door 5 or door 6 answer, which is how you can tell the page is hers

Write the test in their words at the top. Not a goal you would set for them. The sentence they said when you asked how they would know it worked, with the number in it if they gave one. If the sentence you have is "a pipeline" or "one source of truth", you do not have door 6 yet, and the tree cannot start; write the question you will ask to get it instead.

★ Step 1 · the test, her wordsTEST (Adeline, door 6): "The auditor stops asking, and Priya's Monday takes one hour instead of six." Seen by: her, when the letter does not come; Priya, every Monday afternoon.

List the opportunities as they said them. One line each, their words, no diagnosis. Five to seven is normal for a 45-minute meeting. Mark the three that bear most directly on the test; that mark is your first judgement, and you should be able to say why in one sentence per mark.

★ Step 2 · the pains, as said1. "Finance and the POS are about two percent apart, every month." <- strongest 2. "When they disagree, we book finance's number and argue afterwards." 3. "Priya downloads 38 files every Monday. Six hours." <- strong 4. "When a number is wrong, Priya fixes it. Nobody is told." 5. "There are three versions of the stock spreadsheet." <- strong 6. "Singapore and Malaysia use different product codes."

Solutions and the assumption under the strongest. At least two under each strong pain, cheapest first, dearest last. Under each, one line for the assumption that has to be true, because that line is what the first step will test. If one of your solutions is a pipeline, its assumption is almost always "the two copies measure the same thing on the same day"; check it against what she said.

★ Step 3 · solutions and the assumption under eachUnder 1 (two percent apart): a. a written bridge naming each timing gap assumes: card, cash and refunds explain most of it b. nightly pipeline, POS and ledger together assumes: both copies measure the same day (they do not) Under 3 (38 files every Monday): a. one scheduled export, run by Priya assumes: her own login can schedule it (untested) b. the vendor API assumes: an admin login we keep past January Under 5 (three stock sheets): a. declare one real, retire two assumes: she will name one, not Priya's laptop by default b. stock kept in the POS assumes: the POS holds stock today (it does not)

Write the three candidates, six lines each. What, first step, who, needs, which copy is declared real, whose login it runs on. One candidate per strong opportunity. The first step must be something a named person can do this week without asking for money, and the login line must not name a person who is leaving.

★ Step 4 · three candidatesC1 One stock sheet declared real, the other two retired first step: Adeline names the real one; Priya archives two who: Adeline, Priya needs: nothing real copy: the one she names login: none C2 One scheduled export, run by Priya, documented; the vendor API second first step: test whether her login can schedule four outlets who: Priya, me needs: nothing real copy: the POS export, hand fixes logged login: Priya's own C3 A written month-end bridge that states the timing gap first step: last month's export, four outlets, three gaps who: Priya, me needs: nothing real copy: the booked number, POS explained login: none

Score the three, with the rule written above the grid. Impact, confidence, ease, 1 to 10. Write the combination rule first, then the digits, then check your own arithmetic twice. Run it the other way too; if the winner or the order changes when you swap multiply for average, say so under the grid, because that is the honest state of the choice.

★ Step 5 · the grid, rule firstRULE: I x C x E, each 1 to 10. (Some teams average. We multiply, because a weak leg should hurt.) I C E I x C x E average C1 stock sheet 4 8 9 288 7.0 C2 Priya's export 9 5 7 315 7.0 C3 month-end bridge 9 8 7 504 8.0 <- winner Same winner either way. Averaged, C1 and C2 tie; multiplied, C2 is second. Confidence on C2 rises to 8 the day her login schedules one outlet.

Write the pilot in five lines. Scope, partner, test, date, and what it needs. Every line comes from door 5 or door 6. If a line is yours rather than theirs, or came from a question your meeting never reached, mark it as a guess to confirm; session 6 sends the page within 24 hours and the guesses are the questions in the covering note.

★ Step 6 · the pilotPILOT: C3, the written month-end bridge; then C2's first step, same four outlets scope: four outlets (she offered four, never 38) partner: Priya, two hours a week [confirm: not asked in my 45 minutes] test: the auditor's written answer, and a Monday that takes one hour date: board slide in week 6, the auditor's answer in week 8 [confirm] needs: nothing before Q1; nothing on an admin login; the SGD 15,000 waits for a fact

The first project declares a copy and produces a fact she can see. That is the test of a first step, and it is stricter than it sounds. A fact she can see is a page with her own outlets' numbers on it that she can hand to the auditor, not a job that ran. If the first step needs money, it is the second step; if it moves data before a copy is declared real, it is the pipeline that delivered the gap every morning.

Homework

Before session 6

45 min
  1. Build the tree for your real request. Their test at the top in their words, their pains as the row, two solutions and one assumption under each of the three strongest. If you cannot fill the top box, the homework is the question that fills it, and you ask it this week.
  2. Prune to three and write each in six lines, with the declared copy and the login on every one. For any candidate where you cannot say who declared the copy real, write the question that finds out.
  3. Score them with the rule above the grid, then run the grid a second time with the other rule and write one line on whether the winner or the order moved. Check the arithmetic both times.
  4. Write the pilot in five lines and bring all of it to session 6, printed, with the Six Doors sheet from session 1 and the lineage map from session 2. Mark every line that is your guess rather than their answer. The mock meeting runs on your own sheet, and the brief is written from these pages.
Check yourself

Three questions

Clear all three and session 5 gets stamped in your passport.

1 · Why does every candidate carry a line saying which copy it declares real, before anything is moved?

Card settlements land two days late, cash is banked weekly, and refunds never reach the POS. Put the two copies side by side without a declaration and a written bridge, and the variance column is right every night and useful on none of them. Declare which number is booked, write why the other differs, then automate.

2 · The grid scores the stock sheet 4, 8, 9 and Priya's export 9, 5, 7. Why must the combination rule be written above it?

Multiplying punishes a weak leg harder; averaging forgives it. Neither is wrong. The winner here, the bridge at 504 or 8.0, is the same either way, but the order below it is not, and the order below the winner is what she will ask about next.

3 · Kenneth holds the only POS admin login and leaves in January; she has not told the team. What does that do to the pilot?

The last integration attempt stalled the week Kenneth went on leave. Rushing the API before January puts the same dependency first again, and publishing his departure spends a confidence she gave you at trust 3. Design around the fact, keep it in your notes.

Sources covered

What this session teaches, and where it came from

◐Opportunity solution tree: outcome, opportunities, solutions, assumption testsTeresa Torres, Continuous Discovery Habits, Product Talk, 2021; reported from summaries, and taught in depth in the Product Thinking course
◐ICE: impact, confidence, ease, each 1 to 10Sean Ellis and Morgan Brown, Hacking Growth, Currency, 2017; reported, and whether the three are averaged or multiplied is contested across summaries, so the page says write down which. The digits are the engineer's written judgement, and 288, 315, 504 and 7.0, 7.0, 8.0 are that judgement's arithmetic, nothing more
✓Verify the current non-ML solution is optimized before building anything clevererGoogle for Developers, "Introduction to Machine Learning Problem Framing", developers.google.com/machine-learning/problem-framing, accessed 2026-09-29; primary, read at source
✓What the tuned order and the printed order each heard in 45 minutesSession 3's bench, re-run in node on the printed bank file for this page: the tuned order stops after the limits question and never asks for the dates or Priya's two hours; the printed order hears those and misses her test, the four outlets and Kenneth. The mechanism is the finding, never the numbers as facts about a real business
◐Harbourline, Adeline Tan, Kenneth, Priya and every fact in the treeConstructed. The 24 facts are printed in the bench's bank file and invented to be typical, not sourced; the three stories on this page are constructed from them
◐The eight-week timeline, and the auditor who asked for the page againConstructed to show the shape of a pilot that produces a fact; the month-end week is drawn, not dated, and no claim is made about how long a real reconciliation takes or whether the POS allows a scheduled export on an ordinary login

Every fact on this page, and its verification tier, is recorded in the course's source map.

Session 5 cheat sheet · pin this

Her test on top, her wordsA tree with "a pipeline" on top is upside down. Turn it over before you branch.
Pains are a transcript"Three stock sheets" is her pain. "No single source of truth" is your solution in disguise.
Six lines per candidateWhat, first step, who, needs, which copy is declared real, whose login it runs on.
Write the rule above the gridMultiply or average is contested. Write which, then the digits, then check the sums.
Declare, write, then automateNo new tool before a copy is declared real. The bridge before the export, the export before the API.
Pilot: scope, partner, test, dateFour outlets, Priya, the auditor's answer and a one-hour Monday, week 8. Nothing on a login that leaves.