learn-asking-right-questions-as-de-with-phoebe / Session 4 of 6
Learn Asking the Right Questions as a Data Engineer with Phoebe · Session 4 of 6

Teaching while you ask

Every open question on your sheet carries a second sentence: why you are asking, said out loud. Session 3 counted what it buys, a point of trust per open question and one true thing she learns. Tonight is about the sentence itself, because the version most engineers write is true and useless. "The ledger has a two-day SLA behind the POS, so the ETL must handle late-arriving facts" is a correct description of Harbourline that teaches Adeline nothing, since three of its words are words she would have to ask about, and she will not ask. She will nod, and then tell the auditor something you never said. The work of this session is making twelve second sentences plain enough that a person who runs pharmacies learns one real thing from each, and leaves able to say why finance and the POS disagree.

🟡 Core Data engineers, and anyone asked to "connect the systems" No code. A pen. 45 min
0-3 · Welcome 3-18 · The curse, one concept, lesson not lecture 18-40 · Build-along: twelve lines, rewritten 40-45 · Q&A
Part 0

Where we start

You have a sheet of open questions with a teach-back line beside each, and session 3 put the whole bank on the bench. The questions are fine. The second sentences are the risk, because you wrote them in the vocabulary you build in, and you cannot hear that from the inside. Adeline Tan, operations director of Harbourline, a constructed chain of 38 pharmacy and clinic outlets, is the reader tonight. She opened with "Our numbers never match. Finance says one thing, the POS says another." The aim is narrow: by the end of 45 minutes she can repeat one idea about data work in her own words, to her regional GM or to the auditor, and the other eleven lines have landed quietly as single sentences she did not have to decode. Presenting and influence belong to Communication; this is only the sentence you say before a question, and the door you are standing in is mostly door 4, data state (the corridor of six is here).

🎫 Clear all three quiz questions to stamp your passport Live = presented in the 45 minutes Self-study = the full depth, after class ★ Build-along = write it yourself

★ What you walk out with tonight. Twelve teach-back lines rewritten with every word she would have to ask about replaced, each still one sentence; one concept chosen for the meeting, timing not truth, with its ninety-second version written in three plain sentences; and the sentence you hope she says to the auditor. Session 5 takes the same sheet and turns her answers into three projects, starting with one real copy.

Part 1 · covers why you cannot hear your own jargon

Your curse of knowledge, not hers

5 min live

In 1989 Camerer, Loewenstein and Weber showed that better-informed people cannot fully set their information aside when predicting what less-informed people will understand, and named it the curse of knowledge. Tech Writing teaches it in depth, with what it does to documentation. The engineer's version is smaller and sharper: a teach-back line written in the words of the build. "Two-day SLA", "ETL", "late-arriving facts" are three knocks on a table. You hear the whole tune behind them, settlement files, a nightly load, a table that has to accept rows for yesterday, and you judge the line clear from inside that experience. Adeline hears three knocks and the word POS.

ONE LINE, DRAWN TWICE the claim does not change; the three terms she would have to ask about do BEFORE, IN THE ENGINEER'S WORDS three terms she would ask about; she nods instead The ledger has a two-day SLA behind the POS, so the ETL must handle late-arriving facts. "sorry, what do you mean?" AFTER, IN HERS Finance hears of a sale days after the till, so my copy waits for the late money. same claim, no word to ask about, still one sentence; she learns the gap has a cause The circled terms were invisible to whoever wrote the line. Reading it aloud is the only way to see them.
🔍 Click to zoom - the top line is correct and the bottom line is the same line; only the bottom one teaches her anything
LiveThe words she would have to ask about3 min▶

Take any teach-back line on your sheet and read it aloud to someone who does not do data work. Any word that makes them say "sorry, what do you mean?" is a jargon cost, and session 3's bench prices it: the question takes five minutes instead of three or four, because you have to explain, and it costs a point of trust, because she is a little less sure you understand her shop. The technical opener asked five of those in a row, spent 25 of the 45 minutes, and scored 15. A teach-back line was meant to earn trust. With one wrong word it spends it.

The engineer's usual offenders, with the plain words that replace each. Pipeline: the steps a number goes through from the till to the report. ETL: copying numbers out of one system, tidying them, and putting them into another. CDC: copying each change as it happens, instead of the whole file once a week. Schema: the list of columns and what each one means. Idempotent: safe to run twice, so running the copy again does not count a sale twice. SLA: the promise about when it arrives. Warehouse: the one place all the copies are kept. Medallion: keeping a raw copy, a tidied copy and a report-ready copy, one on top of the other. None of the plain versions is longer than a breath, and every one describes a thing she already knows exists: a file, a copy, a promise, a place.

The test is not "would a smart person understand this". Adeline runs 38 outlets across two countries; she is a smart person. The test is whether the word is one she uses at work, and the honest way to find out is her face, which is why the reading is done aloud and never on paper.

Self-studyWhy plain is not dumbed down2 min▶

Douglas Hubbard's definition of measurement, a quantitatively expressed reduction of uncertainty based on one or more observations, is itself a plain sentence. It contains no term of art, and a finance director can check it against her own experience without a glossary. Precision and plainness are not in tension; the words that sound precise to an engineer are usually just familiar to an engineer.

There is a professional reason plain is the norm and not a courtesy. The person paying for the work has to be able to check it, and here the person checking it after her is an auditor. A teach-back line she cannot decode is a claim she cannot test, and a claim she cannot test is one she either accepts on faith or quietly ignores. Both are bad for you: the first because faith runs out on the first number that still does not match, the second because you have spent a sentence and taught nothing. Plain words are how an engineer makes the reasoning behind a build inspectable by the person who has to sign it off.

Real world

The nod that moved the disagreement faster. A constructed case, and a common shape. An engineer told Adeline "we will put the ledger sync on a daily SLA", watched her nod, and moved on. She told the auditor that from next month the two numbers would agree every day. The sync ran daily, exactly as promised. The two numbers now disagreed every day instead of once a month, by the same gap, because card money still landed two days after the till and cash still went to the bank once a week. Nobody lied and nobody was careless. A term the engineer could not hear as jargon went past a person too polite to stop the meeting, and the belief it left behind became a promise to an auditor before anyone looked at it.

Part 2 · covers the one idea that gets explained properly

One concept per meeting

5 min live

Twelve teach-back lines, and she will remember one. That is not a failure of the other eleven; single sentences land as background, and background is what most of them should be. But one idea per meeting deserves ninety seconds of proper explanation: what it is, why it costs, what it means for her month-end. The choice is not the idea you find most elegant. It is the idea a false belief would attach to if you left it unexplained, because that belief is the one that turns into a wrong build: a pipeline that moves the disagreement faster instead of settling which copy is real.

TWELVE LINES, ONE PULLED OUT eleven stay single sentences; one gets ninety seconds, chosen by the belief it prevents THE ONE: THE TWO NUMBERS DISAGREE ABOUT TIMING, NOT TRUTH What it is: the till counts a sale today; finance counts it when the money lands. Why it costs: card money lands two days late, cash weekly, refunds only in finance. Her month-end: numbers by day three leave two days to line up the gap by day five. ninety seconds, three sentences, and "finance is just wrong" never forms 1 2 3 4 5 6 7 8 9 10 11 12 pulled 1-2 outcome · 3-4 decision · 5-6 current way · 7-8 data state · 9-10 constraints · 11-12 success
🔍 Click to zoom - the pulled card is the only one that gets three sentences, and it is chosen by the belief it prevents
LiveChoosing the one2 min▶

Look at the five false beliefs the bench records on the fast run, because each one is a concept that was never explained. "The POS is the source of truth" and "finance's number is simply wrong" both attach to timing: the bank file marks both as contradicted by the same fact, that card settlements land two days late and cash is deposited weekly. "Pull everything daily" attaches to freshness: Monday's reorder needs weekly, month-end needs day three. "The vendor API is already in use" attaches to what exists versus what is possible: nobody has ever used it. "Stock lives in the POS" attaches to which copy is real: there are three spreadsheets, and the one Priya trusts is on her laptop. Pick the belief most likely to form in this meeting with this person, and the concept behind it is your one.

For Harbourline the choice is close to forced. The two numbers disagree about timing, not truth, because two of the five beliefs attach to it, because her opening line is literally the question it answers, and because the auditor asked it in writing. On the fast run, "So finance's number is just wrong?" is the fourth question asked and is in the notes by minute 5, before a single true fact. The other candidates are real, and the next meeting can have one of them. Choose one, not two; two concepts at ninety seconds each is a lecture with an interval.

LiveThe ninety-second version2 min▶

Three sentences, in a fixed order: what it is, why it costs, what it means for her month-end. Written in full for the timing concept, as it would be said right after she answers "where does finance's revenue number come from, step by step?":

What it is. "The till counts a sale the moment it rings up, and finance counts it when the money reaches the bank, so on any given day the two systems are counting sales from different days." Why it costs. "Card money lands two days after the sale, cash goes to the bank once a week, and refunds are only ever entered in the accounting system, so the POS never sees them, and copying either number into a new report faster would only show you the same gap sooner." Her month-end. "Finance posts by the fifth working day, so if we have the numbers by day three we have two days to line up the late card money, the weekly cash and the refunds, and whatever is left after that is the part of the two percent worth a real question."

Ninety seconds, then back to the next question. Notice what the version does not say: it does not say the whole two percent is timing. Her sheet says it is mostly timing, and the honest sentence leaves room for the rest. The tell that it worked is that she uses the word "timing" herself later in the meeting, as a reason rather than an excuse.

Self-studyThe test that she could repeat it to the auditor2 min▶

Adeline told you that last month the auditor asked which number was right, and she could not tell him. If the one concept landed, next time she can say something like "the two numbers count the same sales on different days; card money lands two days late, cash weekly, and refunds only exist in finance's system." That sentence is the whole test: it is hers, it is short, it carries the reason, and it would survive a sceptical follow-up from a person whose job is sceptical follow-ups. If instead she says "the data team is looking at the sync", the concept was heard and not learned.

Write the sentence you hope she says before the meeting. It forces the ninety seconds to be built backwards from a line a non-data person could carry, and it is the cheapest rehearsal there is. It also checks the choice itself: if you cannot write a one-line version an auditor would accept, you have picked an idea that matters to you and not to her.

Real world

The wrong one. Constructed. An engineer chose idempotency as the concept for Adeline's meeting: running the copy twice must never count a sale twice. It was explained well, and she repeated it perfectly. In minute five she had also said "so finance's number is just wrong?", and nobody stopped to explain timing, so the first build treated the POS as the real copy and flagged finance's figure as the error every month. The concept she learned was true. It was the wrong one for that meeting, because no false belief was waiting to attach to it, and one was waiting to attach to timing.

Part 3 · covers the difference between teaching and talking

Lesson, not lecture

4 min live

A teach-back line passes three tests: plain, true, one sentence. The third is the one engineers fail, because the moment a line touches something interesting, settlement files or duplicate rows or who holds the admin login, it wants a second sentence, and then a design. The tell of a lecture is easy to hear from across the room: she stops answering and starts nodding. Rob Fitzpatrick's third rule for talking to customers is the whole discipline, talk less and listen more, and it applies with extra force to the person who is supposedly asking the questions.

TWO MEETINGS, 45 MINUTES EACH hatched is the engineer talking; white is her talking; teal is a teach-back line LECTURE she stops answering and starts nodding; the gaps are her saying "right" 0 min 15 30 45 LESSON she talks; each tick is one plain sentence, placed where the tuned order starts a question 0 min 15 30 45 Lecture rail drawn, not recorded. Lesson ticks sit where the bench's tuned order starts its 11 questions.
🔍 Click to zoom - the lesson rail is mostly white because most of a good meeting is her talking; the white itself is drawn, not measured
LivePlain, true, one sentence2 min▶

Failing, before "who can log in to each of those, and pull an export?": "Credential ownership is usually the critical path on an integration, and if the POS admin account is a single point of failure we would want a service account issued before any CDC or ETL is scoped." True, and it fails all three tests at once: five words she would ask about, two claims joined into one, and a design hiding inside a reason.

Passing, same question, as the bank prints it: "Access is the first blocker on most data projects, so I ask early and I ask by name." Plain, because every word is one she uses; true, because it is how these projects stall; one sentence, so she is answering again within three seconds. On the bench's tuned order this is the seventh question, asked once trust already stands well above the level her most sensitive fact needs, and it is the one that brings out Kenneth: the only IT person, the only POS admin login, leaving in January, and the team has not been told. The failing version would have earned a nod and no name.

Self-studyWhen she asks a follow-up, you have a lesson2 min▶

There is only one proof that a line taught something, and it is a follow-up question from her. "So if we waited for the card money, would they match?" means timing landed. "Wait, which of the three stock sheets would you use?" means the real-copy line landed. A nod proves nothing, and a polite "makes sense" proves slightly less than nothing, because it closes the topic. Silence after a teach-back line is a reason to ask your next question, not to add a sentence.

On the bench this is the mechanism, not a metaphor. Every open question earns a point of trust, and seven of the 24 facts on her sheet sit behind a trust gate she will not cross unprompted. The teach-back line is where that point is earned: she answers the next question more fully because the last one came with a reason. A lecture spends minutes and earns nothing, which is the same arithmetic as the technical opener in session 3 with a friendlier face.

Real world

The follow-up that changed the build. Constructed. After "two numbers built along two paths usually disagree about timing long before they disagree about truth", Adeline asked: "so if we waited until the card money lands, would they match?" The honest answer was "mostly, and the refunds are the rest." That exchange was the lesson landing and the project changing shape in the same breath. It moved the first piece of work away from a faster sync, which would have shown the same gap sooner, and towards a written month-end reconciliation that says why the two differ, which is where session 5 will find it.

Build-along

Rewrite your twelve lines for Adeline

★ 22 min · everyone writes

Your question sheet, teach-back column only. Twelve lines go in as you wrote them and come out with every word she would have to ask about replaced, still one sentence each. Then one is chosen and given its ninety seconds. If you did not bring a sheet, the twelve lines from the bench's bank are printed in step 1, exactly as the bank prints them, and they need the same work; several of them were written by an engineer too.

THE SHEET AGAIN, TEACH-BACK COLUMN WIDE request, in her words: "our numbers never match; finance says one thing, the POS another" DOOR THE QUESTION TEACH-BACK, BEFORE AND AFTER 2 Outcome if the numbers matched, what would differ in six months? I can check a pipeline against an outcome. I cannot ... I can check the steps a number goes through against the change you want, never the other way round 6 Current way where does finance's revenue number come from, step by step? Two numbers built along two paths usually disagree about timing long before they disagree about truth. kept as written: already plain, and this is the one concept 7 Data state which systems does one sale touch, from till to the ledger? Every hand-off between systems is a place a number can ... Every time a number is copied from one system to the next it can change, so I am counting the copies the one concept: row 6 Struck lines are true. They are struck because she would have had to ask, and she would not have asked.
🔍 Click to zoom - the column that was narrowest on the question sheet is the one that outlives the meeting

Paste your twelve teach-back lines as they are. No editing yet. If you have no sheet, these twelve are the bank's, two per door in door order, the same twelve questions the Six Doors preset asks first on session 3's bench.

★ Step 1 · the twelve, as written1 A mismatch is two systems answering two different questions. I need the exact pair before I can say which one is right. 2 I can check a pipeline against an outcome. I cannot check an outcome against a pipeline. 3 The deadline tells me how fresh the data has to be, and who decides tells me whose definition wins when they differ. 4 Weekly and monthly numbers can share a source and still need different freshness. I build to the slowest acceptable decision, not the fastest possible one. 5 The current file is the spec. Every step done by hand is a step I have to reproduce exactly before I can improve it. 6 Two numbers built along two paths usually disagree about timing long before they disagree about truth. 7 Every hand-off between systems is a place a number can change. I am counting the hand-offs. 8 Two names for one thing is the most common reason a total is wrong. It is a naming problem before it is a data problem. 9 I ask for the limits first so I do not propose something you could never approve. 10 A date I can aim at is worth more than a scope. An auditor's letter is a deadline with a name on it. 11 If we agree on the test now, neither of us has to argue about it later. 12 The person who works with me is the person who can run it after I leave.

Circle every word she would have to ask about. Read each line aloud to the person next to you. Mark the word at the moment their face changes, not the word you suspect. In the bank's twelve, look hard at "pipeline", "source", "freshness", "spec", "hand-off" and "scope": each is borderline, and borderline means circle it.

★ Step 2 · the circles2 I can check a [pipeline] against an outcome. I cannot check an outcome against a [pipeline]. 4 Weekly and monthly numbers can share a [source] and still need different [freshness] ... 5 The current file is the [spec]. Every step done by hand is a step I have to reproduce ... 7 Every [hand-off] between systems is a place a number can change. I am counting the [hand-offs]. 10 A date I can aim at is worth more than a [scope] ... Your own sheet will have more. "CDC", "ETL", "SLA", "schema" and "idempotent" are the usual five.

Replace each circled word, keeping one sentence. The replacement is the plain thing the word stands for, and it is allowed to be longer than the word it replaces. It is not allowed to become a second sentence.

★ Step 3 · the replacements2 I can check the steps a number goes through against the change you want, never the other way round. 4 The Monday report and the month-end number can come out of the same till and still be needed on different days, so I build for the latest day that still works. 5 The file you build today is the plan nobody wrote down, and every step done by hand is one I must copy exactly before I improve it. 7 Every time a number is copied from one system to the next it can change, so I am counting the copies. 10 A date I can aim at is worth more than a list of features, and an auditor's letter is a date with a name on it.

Read all twelve aloud and merge or cut any that are two. The test is a breath: if you had to take one in the middle, it is two sentences. Half the bank's lines are two; join them where the second is the reason for the first, and cut the first where the second is the whole point.

★ Step 4 · one that was two, and the mergeBefore: A mismatch is two systems answering two different questions. I need the exact pair before I can say which one is right. After: Two numbers that disagree are usually answering two different questions, so I need the exact pair before I can say which is right.

Choose the one concept and write its ninety-second version. Pick by the false belief most likely to form in this meeting. Three sentences in the fixed order: what it is, why it costs, what it means for her month-end. Mark that row on the sheet.

★ Step 5 · the one, chosen and writtenConcept: the two numbers disagree about timing, not truth (row 6, current-way door) Beliefs it prevents: "the POS is the source of truth" and "so finance's number is just wrong?" What it is: The till counts a sale when it rings up; finance counts it when the money reaches the bank. Why it costs: Card money lands two days late, cash is banked weekly, refunds exist only in finance's system, so a faster copy shows the same gap sooner. Her month-end: Finance posts by day five, so numbers by day three leave two days to line up the gap, and what is left is worth a real question.

Write the sentence you hope she says to the auditor. One line, in her voice, that a sceptical auditor would accept. If you cannot write it, go back to step 5 and pick a concept that matters to her rather than to you.

★ Step 6 · her sentence"The two numbers count the same sales on different days. Card money lands two days late, cash goes in weekly, and refunds are only in finance's system."

The teach-back lines are the part of the meeting that outlives it. The facts go into your notes and then into session 5's three projects. The lines go into her, and she carries them into the next meeting you are not in, which for Adeline is a written answer to an auditor. Keep the rewritten column; session 6's one-page brief reuses the same plain words, so that what she reads in 24 hours matches what she heard.

Homework

Before session 5

30 min
  1. Rewrite the lines for a real request. Take the question sheet you built for something on your own desk, a "connect these systems" or a "why don't these match", and run steps 2 to 4 on its teach-back column. Keep the before and after side by side; the difference is the lesson.
  2. Record yourself asking three questions, each with its teach-back line, on your phone. Play it back and count the words the business person would have to ask about. Most people find one per line on the first pass and none on the third.
  3. Pick the one concept for your next meeting. Name the false belief it prevents, write the three sentences, and write the line you hope the business person repeats to whoever asks them next, a boss, a finance team or an auditor.
  4. Bring the rewritten sheet to session 5. Her answers become three candidate projects there, and the plain words you settled on tonight become the words each project is described in.
Check yourself

Three questions

Clear all three and session 4 gets stamped in your passport.

1 · What does the curse of knowledge predict about an engineer's own teach-back lines, and why is reading them aloud the test?

Camerer, Loewenstein and Weber's finding is that the better-informed person cannot fully set their knowledge aside when predicting what the less-informed person understands. "Late-arriving facts" is invisible to the person who designs tables for them. The listener's "sorry, what do you mean?" is the only reliable detector, and she will usually nod instead, which is why you read to a colleague first.

2 · For the Harbourline meeting, why is "the two numbers disagree about timing, not truth" the one concept worth ninety seconds?

A concept is chosen by the belief it prevents, not by how interesting it is. On the fast run, "So finance's number is just wrong?" is in the notes by minute 5, before a single true fact. And her sheet says the gap is mostly timing, not all of it, with refunds living only in the accounting system; the honest ninety seconds leaves room for the rest.

3 · What separates a lesson from a lecture, and what is the only proof that a line taught something?

Fitzpatrick's third rule, talk less and listen more, is the whole discipline. On the bench the mechanism is trust: every open question earns a point, seven of her 24 facts sit behind trust gates, and the teach-back line is where the point is earned. "Access is the first blocker on most data projects, so I ask early and I ask by name" brings out Kenneth; a paragraph about service accounts earns a nod.

Sources covered

What this session teaches, and where it came from

✓The curse of knowledge, the term and the findingCamerer, Loewenstein and Weber, "The Curse of Knowledge in Economic Settings", Journal of Political Economy 97(5), 1989. One paragraph here; Tech Writing teaches it in depth
✓Talk less and listen more; the third ruleRob Fitzpatrick, The Mom Test, 2013; reported from summaries, and only his verified wording is quoted anywhere on these pages
✓Measurement as a plain sentenceDouglas W. Hubbard, How to Measure Anything, 3rd ed., Wiley, 2014; definition reported as it appears across sources, book not opened here
✓Jargon opener 15, the fourth fast question at minute 5, the access line seventh on the tuned orderCounted on session 3's bench from the printed bank file and re-run in node for this page; the ordering and the mechanism are the finding, never the numbers as facts about a real business
◐The lecture and lesson timelinesThe lecture rail is a constructed illustration of a shape; the lesson ticks are the bench's tuned-order question starts, and the talk time between them is drawn, not measured. No study of talk time in discovery meetings is cited, because none was read
◐Harbourline, Adeline Tan, Kenneth, Priya and the three storiesConstructed. The settlement timing behind the two percent, the refunds that live only in accounting, the SLA nod, the wrong concept and the card-money follow-up are invented to be typical; every fact behind them is printed in the bench's bank file

Every fact on this page, and its verification tier, is recorded in the course's source map.

Session 4 cheat sheet · pin this

Your curse, not hersYou cannot hear your own jargon. Read the line to someone else and watch their face.
The engineer's offendersPipeline, ETL, CDC, schema, idempotent, SLA, warehouse, medallion. Each has a plain word: a copy, a promise, a place.
Plain is not dumbed downThe person paying, and her auditor, have to be able to check the work.
One concept per meetingNinety seconds, three sentences: what it is, why it costs, her month-end. Chosen by the belief it prevents.
Timing, not truthCard money two days late, cash weekly, refunds only in finance. Mostly timing, and say "mostly".
The only proofA follow-up question from her. A nod proves nothing; "makes sense" closes the topic.