learn-asking-right-questions-as-da-with-phoebe / Session 2 of 6
Learn Asking the Right Questions as a Data Analyst with Phoebe · Session 2 of 6

Reading their data state in plain words

Door 4 is the one an analyst knows how to open, and the one Adeline cannot answer in your words. She has never seen a schema and does not know what an export is. She does know that the stock number is typed by outlet managers on Friday afternoons, that Kenneth is the only person who can get into the till system, and that the loyalty app belongs to a vendor. Those three things are the data state. Tonight is how to get them out of her in plain words: whether each number was recorded by a machine or typed by a person, a five-rung ladder asked as questions rather than shown as a score, who owns each source and who holds the only key, and the one-page map you draw from her answers and send her before you send a chart. Session 1 walked the corridor; it is here if you need the other five doors.

🟡 Core Analysts, and anyone who gets asked for numbers No code. A pen. 45 min
0-3 · Welcome 3-18 · Typed or recorded, the ladder, the owners 18-40 · Build-along: the data-state map 40-45 · Q&A
Part 0

Where we start

An analyst asked about data state will ask about systems, and a person who runs 38 pharmacies will hear knocking. The state of Harbourline's data is not a diagram. It is a set of facts about people and habits: a till records, an outlet manager types, a supplier order lives in a chat thread and nowhere else, one person holds the only admin login. Every one of those facts is a plain-words question away, and none of them is a schema question away. The three parts tonight are three kinds of plain question: where each number comes from, how mature the habit around it is, and who can say yes. The build-along turns her answers into a map with boxes she can correct.

🎫 Clear all three quiz questions to stamp your passport Live = presented in the 45 minutes Self-study = the full depth, after class ★ Build-along = write it yourself

★ What you walk out with tonight. A one-page data-state map for a request you actually have: every number on the report traced to a till, a person or nowhere, an owner and a login holder by name for each source, a rung on the five-rung ladder written beside each one, and the single sentence you send with it. Session 3 puts the same facts on the bench and prices them: the one key on the map is worth 3 points that most meeting orders never reach.

Part 1 · covers where each number comes from

Typed by a person, or recorded by a machine

5 min live

The first data-state question is not "what systems do you have". It is "where does this number come from", asked once per number on the Monday report. The answer is always one of three. It was recorded by a system as a side effect of work, like a sale at a till. It was typed by a person, like a stock count on a Friday. Or it is not recorded anywhere, like a supplier order that went over WhatsApp. Those three origins behave differently in a build, and the person in front of you knows which is which without knowing why it matters.

EVERY NUMBER ON THE MONDAY REPORT, TRACED TO WHERE IT WAS BORN three origins, and only one of them is a machine MONDAY REPORT, WEEK 38 Sales by outlet 412,880 Stock on hand 3,140 units plus an "adjustments" column nobody can explain Supplier orders placed no number built by Priya, six hours, every Monday RECORDED by the till a side effect of a sale; one CSV per outlet, three years of history, codes differ by country TYPED by outlet managers Friday afternoons, one shared Excel per outlet, three versions in circulation NOT RECORDED anywhere orders go over WhatsApp; there is no order table One question finds all three: "where do the stock numbers come from, step by step?" Not "what is the source system".
🔍 Click to zoom - the terracotta arrow is the number that decides what you can build, because it was typed on a Friday
LiveThe three origins, and the question that finds them3 min▶

Take the Monday report and go down it one number at a time. For each, ask the bank's question g08: "Where do the stock numbers in it come from, step by step?" with its teach-back said first: "A number that is typed by a person on a Friday behaves differently from one a till records. I need to know which I am dealing with." She does not need to know what a source system is to answer that. She knows that sales come off the till and that stock is what the outlet managers put in the shared Excel on Friday, because she has chased them for it.

The three answers carry three different builds. A number recorded by a system arrives on its own, with a timestamp, in the same shape every time; at Harbourline that is the POS, one CSV per outlet, three years deep. A number typed by a person arrives when the person remembers, in whatever shape they typed, and at Harbourline there are three versions of that shape in circulation and an "adjustments" column nobody can explain. A number that is not recorded cannot be built on at all until somebody starts writing it down; supplier orders live in WhatsApp threads and there is no order table anywhere.

Say the middle case out loud when you hear it, because it is the one that quietly decides the project. A stock number typed on Friday cannot feed a Monday decision any fresher than Friday, whatever the dashboard refreshes at. It also cannot be trusted more than the person typing it is checked, which at Harbourline is not at all. That one answer tells you the first build is a single agreed stock sheet with a checker, not a chart of the sales.

Self-studyWhy data preparation eats the project, quoted as it stands2 min▶

Two sources are usually run together into one number, and they should not be. In 2014 Steve Lohr reported in The New York Times that data scientists spend 50 percent to 80 percent of their time collecting and preparing data before it can be explored. In 2016 CrowdFlower's data science survey reported that respondents spent 60 percent of their time cleaning and organising data and a further 19 percent collecting it. The two sources measured two different things with two different methods and gave two different shapes of answer: one a range for collecting and preparing together, the other two separate figures for cleaning and collecting. Quote whichever you use as it stands, and never the "80 percent cleaning" figure that circulates as if it were one measurement, because it is not one anyone made.

The point for door 4 is the reason behind both figures. Preparation time is mostly the cost of typed and absent numbers: reconciling three versions of the stock sheet, working out what the adjustments column meant, discovering the order data does not exist. Every minute you spend at door 4 asking "typed or recorded" is a minute you are not spending in week three finding out the hard way.

Real world

The adjustments column. A constructed case, but the column is real in most companies. Harbourline's Monday Excel has a column called "adjustments" that nobody can explain, and it took three questions to find out what it was. Priya adds it because two outlets renamed their SKUs last year without telling anyone, so their stock lines no longer match the POS product codes, and rather than fix the codes she corrects the totals by hand every Monday. The column is not a fudge. It is the product-master problem, written down in the only place anyone would let her write it. Ask "where does this number come from" and the answer is a recorded number, plus a typed correction, plus a naming problem nobody owns, all in one cell.

Part 2 · covers the maturity ladder as questions

Five rungs, asked in plain words

5 min live

Once you know where a number comes from, the next thing is how mature the habit around it is: whether it is made the same way each week, whether anyone wrote that way down, whether anyone checks. DAMA-DMBOK's data management maturity model gives five level names for exactly that. Nobody in a discovery meeting should ever hear the level names. What she hears is five plain questions, one per rung, and what you write down is which rung each source sits on.

THE LADDER: FIVE RUNGS, ONE PLAIN QUESTION EACH rung names from DAMA-DMBOK; the questions are ours; she only hears the questions 5 Optimized 4 Managed 3 Defined 2 Repeatable 1 Initial / Ad hoc "Has it got better on its own in the last year?" "Does anyone check afterwards whether it was right?" "Is any of it written down?" "Does the same person do it the same way every week?" "When the number is wrong, who fixes it, and how do they know?" Harbourline Adeline, asked five questions Priya does it the same way every Monday, so it is past rung 1; nothing is written down and nobody checks, so it is not yet rung 2 in full. There is no rung 0.
🔍 Click to zoom - the terracotta tag is where the Monday report sits, and it is written in your notes, never said to her as a number
LiveThe ladder as questions, not as a score3 min▶

DAMA-DMBOK, 2nd edition, chapter 15, names five levels of data management maturity: Initial/Ad hoc, Repeatable, Defined, Managed, Optimized. Five, not six: DMBOK has no level 0, and a "not started" level you may have seen belongs to a different framework. The names are the whole of what is borrowed. The questions beside each rung are ours, written so a person who runs pharmacies can answer them about her own Monday.

Rung 1: "when the number is wrong, who fixes it, and how do they know?" If the answer is "Priya notices, usually" the habit is ad hoc. Rung 2: "does the same person do it the same way every week?" Yes, Priya, six hours, from the same export, which is why Harbourline is past the bottom rung. Rung 3: "is any of it written down?" No. There is a spreadsheet with an adjustments column and the method is in Priya's head, which is also why her two weeks of leave in November matter. Rung 4: "does anyone check afterwards whether it was right?" Nobody, which is why nobody trusts it. Rung 5: "has it got better on its own in the last year?" It has got a column longer.

Write the rung beside each source in your notes and never tell her the number. "You are a 1.5" is a grade, and a grade ends a conversation that was going well. What she hears is five questions that each made her notice something about her own shop, and what you carry out is a per-source reading that tells you where to start: the source on the lowest rung that feeds the biggest decision. The real assessment, with the practices behind each level, is a governance discipline, taught in the Governance 101 course; in a 45-minute discovery meeting the ladder is an interview aid and nothing more.

Self-studyTwo other frames, one line each2 min▶

Joe Reis and Matt Housley, in Fundamentals of Data Engineering (2022), describe companies as starting with data, scaling with data or leading with data, reported here from summaries rather than a page. Harbourline is starting with data: one recorded source, one person who assembles it, and a request for a dashboard that is really a request to be able to trust a number. Everything you propose should fit a company at that stage, which rules out most of what a vendor would propose.

Leandro DalleMule and Thomas Davenport, in "What's Your Data Strategy?" (Harvard Business Review, 2017, reported), ask whether a company needs a single source of truth or several fit-for-purpose versions of the truth. Harbourline has multiple versions by accident: three stock spreadsheets in circulation, none of them the agreed one. Their frame is useful because it names the choice. A company can decide to run several versions; it should not discover it has.

Real world

The Friday rung. Constructed, and typical. Adeline answered rung 2 with "yes, the outlet managers all update it on Friday", which sounds like Repeatable. The follow-up, "the same way?", got a pause and then "well, some do it Friday morning and some Sunday night, and two of them keep their own copy". That is how three versions come to exist: not through anyone deciding to, but through the same instruction being followed five slightly different ways. The rung question found it in under a minute, and it never came up when the analyst before you asked about the source system.

Part 3 · covers owners, access and the one key

Owners, logins, and the one key

5 min live

The last data-state facts are about people: who owns each source, meaning who can say yes to a change or an export, and who can actually log in. At Harbourline nobody owns the product master, which is how two outlets came to rename their SKUs; the loyalty data is owned by an app vendor and an export needs a contract clause; the Malaysian customer data sits under PDPA with a head-office lawyer who takes four weeks to answer anything; and one person, Kenneth, holds the only POS admin login. Kenneth is leaving in January, and she has not told the team.

THE HARBOURLINE DATA-STATE MAP, AS SHE CAN READ IT four boxes, an owner or "nobody" on each, one key, one lock POS, one cloud vendor CSV per outlet, 3 years back codes differ SG vs MY login: Kenneth, only him Stock spreadsheets, x3 typed Fridays, 3 versions product master: unowned owner: nobody Supplier orders WhatsApp threads no order table anywhere owner: nobody Loyalty app export costs extra PDPA, lawyer: 4 weeks owner: the vendor Monday report Priya, Excel, six hours the key leaves in January dashed: never reaches the report Every box has an owner or the word "nobody". She can correct a box. She could never correct a schema.
🔍 Click to zoom - the terracotta key is one login held by one person who is leaving, and it is the fact the whole build depends on
LiveOwner means who can say yes2 min▶

"Who owns this data" is a question a business person hears as "whose department is it", which is not the answer you need. The bank's question g13 asks it the usable way: "What does the loyalty app hold about a customer, and who owns that data?" with the teach-back "Owned means who can say yes to an export. That is usually a contract, not a login." Said that way, Adeline's answer is exact: the vendor holds it, an export costs extra and needs a clause, and anything with Malaysian customer data goes past the head-office lawyer, who takes four weeks.

Ask the same question of every box. Who can say yes to changing a product code? Nobody, which is the answer that explains the renamed SKUs and the adjustments column in one go. Who can say yes to a new column in the stock sheet? Whichever outlet manager opens it first. An unowned source is not a gap in your notes to fill in later. It is the first thing to propose an owner for, and Priya, two hours a week, is the obvious candidate.

LiveThe question you ask by name2 min▶

Question g11 is short and has to be asked with a name in it: "Who can log in to the POS back office and pull an export?" Teach-back: "Access is the first blocker on most data projects, so I ask early and I ask by name." The name is the point. "IT can" is not an answer; "Kenneth can, and only Kenneth" is, and it is the answer that makes you ask what happens in January.

That second fact, that Kenneth is leaving and she has not told the team, does not come out on the first question, whatever you ask. On the bench it sits behind the highest trust gate on the sheet: she only volunteers it once four or five open questions with their reasons said aloud have convinced her you are trying to help her and not to audit her. That is why door 4 is the fourth door and not the first. Walk in and ask who holds the admin login before she knows why you are asking, and you get "our IT guy". Ask it after the Monday walk-through and the stock sheet, with the teach-backs in between, and you get the name, the date and the fact she has been carrying alone. Session 3 shows the same thing as a number: the fact is worth 3 points, and most question orders never reach it.

Self-studyWhat the map is for2 min▶

The map above is the first thing you send Adeline after the meeting, before any chart, before any proposal. It has four boxes, an owner or the word "nobody" on each, a key, a lock and one target. It contains no word she would have to ask about. She can look at it on her phone on Monday and say "the stock sheet is not three versions, it is four" or "actually Kenneth's deputy also has a login", and that correction is worth more than a week of your building. She could never make the same correction to a schema diagram, because she would not know which box was wrong.

The map is also your own honesty check. If a box on it says "nobody", the project has an ownership task before it has a data task. If the only key is on one person, the project has a continuity task before it has a chart. If an arrow is dashed, the number at the end of it cannot be built on until someone starts recording it. A map with those three marks on it is a project plan that she drew, and that is why it goes first.

Build-along

Draw the data-state map from her answers

★ 22 min · everyone writes

One page, drawn by hand, from answers a business person gave in plain words. Take the request you brought from session 1, or Adeline's if you did not bring one, and build the map you will send her within a day of the meeting. Nothing on it is a schema. Every box is something she can correct.

THE BLANK MAP, WITH THE FIVE QUESTIONS THAT FILL IT POS recorded, by the till login: Kenneth only 3 years; paper before source 2 source 3 source 4 the report she asked about who builds it, how long it takes IN THE MARGIN 1 What is on the report? 2 Typed, recorded, or absent? 3 Who owns it? Who can log in? 4 How far back? Who, when away? 5 "Which box is wrong?" the line you send it with Four boxes is usually enough. If you need more than six, you are drawing systems, not sources; go back to the report and count the numbers on it.
🔍 Click to zoom - one box is filled to show the depth: an origin, a name, a horizon, and nothing she would have to ask about

List every number on the report, in her words. Not the columns you would design; the numbers she reads. If the report does not exist yet, list the numbers she says she wants. Each line on this list becomes an arrow on the map.

★ Step 1 · the numbers on the Monday report1. Sales by outlet, last week 2. Stock on hand per outlet, plus an "adjustments" column 3. Which outlets are "down" versus the week before (the GM's Monday question) 4. Supplier orders placed (she wants this; it is not on the report today)

One origin per number: recorded, typed, or absent. Beside each, write the question that found it, so you can see afterwards which door it came out of and repeat it next time. Say the teach-back first every time; it is the reason she answers the step-by-step version instead of "from the system".

★ Step 2 · origin per number, with the question that found itSales by outlet RECORDED the POS till, CSV per outlet. Found by: "which systems does one sale touch, from the till to head office?" Stock on hand TYPED outlet managers, Fridays, shared Excel, 3 versions. Found by: "where do the stock numbers come from, step by step?" Adjustments column TYPED Priya, Mondays, by hand, to correct two outlets' renamed SKUs. Found by: "what goes in this column?" asked three times Outlets "down" DERIVED Priya compares this week to last in the same Excel. Found by: "show me the file" Supplier orders ABSENT WhatsApp threads; no order table. Found by: "where would I find last month's orders?"

Owner and login per source, by name. "Owner" means who can say yes to a change or an export. "Login" means who can actually get in. They are often different people, and one of them is often nobody. Write the name or write "nobody"; never write a department.

★ Step 3 · owner and login, by namePOS owner: the vendor, on contract login: Kenneth (only) leaving January, team not told Stock sheets owner: nobody login: every outlet manager, own copy Product master owner: nobody two outlets renamed SKUs themselves last year WhatsApp orders owner: nobody the pharmacist's phone in each outlet Loyalty app owner: the app vendor export costs extra + contract clause; MY data under PDPA, lawyer 4 weeks

How far back, and what happens when the person is away. Two questions per source. The first tells you how much history you can build on. The second finds every single point of failure on the map, and at Harbourline there are two: Priya, on leave for two weeks in November, and Kenneth, gone in January.

★ Step 4 · horizon and absencePOS 3 years of history; paper before that. When Kenneth is away: nobody can pull an export. After January: nobody at all. Stock sheets since whenever each outlet started its copy. When a manager is away: that outlet's line is last week's, and nobody notices. Monday report kept as Excel files, one per week. When Priya is away: no report. Two weeks in November, already booked. Loyalty app the vendor knows. When the vendor is slow: four weeks, then the lawyer.

Draw the map. Boxes for sources, one box for the report, arrows for what reaches it today, dashed arrows for what does not. Put the owner or "nobody" in every box, mark the one key, mark the lock. A monospace sketch in an email is fine; a photo of a pen drawing is better, because it looks like something she is allowed to correct.

★ Step 5 · the map, as it goes in the email+-----------------+ +------------------+ +----------------+ +----------------+ | POS (till) | | Stock sheets x3 | | WhatsApp orders| | Loyalty app | | recorded | | typed, Fridays | | not recorded | | vendor-owned | | login: Kenneth | | owner: nobody | | owner: nobody | | export: clause | | [the one key] | | codes: unowned | | | | [lock, PDPA] | +--------+--------+ +--------+---------+ +-------+--------+ +-------+--------+ | | : : v v : (nothing) : (nothing) +---------------------------------------------+ | Monday report - Priya, Excel, 6 hours | +---------------------------------------------+

Write the one line you send with it. Not a summary, not a proposal, not a chart. One sentence that says what the map is and asks her to correct it. Send it within a day, while she still remembers what she told you.

★ Step 6 · the covering lineHi Adeline, here is what I understood about where your numbers live; which box is wrong?
The same email, as it is usually sentHi Adeline, please find attached a first draft of the source-system architecture and a proposed data model for the sales dashboard. Let me know if you have any questions.

Send the map, not a chart, first. A chart says "I have started building"; a map says "I have started listening". She can correct the map on her phone in a minute, and every correction is a build week you do not lose. Session 6 folds the corrected map into the one-page brief; session 5 uses its "nobody" boxes to pick the first joint project.

Homework

Before session 3

30 min
  1. Draw the map for your own request. Every number on the report, an origin for each, an owner or "nobody" in every box, arrows for what arrives and dashed arrows for what does not. If you cannot fill a box, that is the question you ask next.
  2. Find the one key. Somewhere on your map is a login, a password, a laptop or a person that everything passes through. Mark it. Write down what happens the week that person is away.
  3. Write the rung beside each source. Use the five questions, not the five names. Then mark the source you would move up first, and say why in one line: it should be the lowest rung feeding the biggest decision.
  4. Bring the map to session 3. The bench prices every fact on it, and you will see which of your boxes most meeting orders never fill.
Check yourself

Three questions

Clear all three and session 2 gets stamped in your passport.

1 · Adeline says the stock number is typed into a shared Excel by outlet managers on Friday afternoons. Why does that single answer change what you can build?

Recorded, typed and absent are three different builds. The typed case is the one that quietly decides the project, and at Harbourline it also explains the three versions in circulation and the adjustments column.

2 · The maturity ladder is used in the meeting as five plain questions and never shown as a score. How many rungs does it have, and why is the number kept in your notes?

The names are DMBOK's; the questions are ours. What you carry out is a per-source reading that says where to start: the lowest rung feeding the biggest decision. The real assessment belongs to a governance course, not a discovery meeting.

3 · Kenneth holds the only POS login and is leaving in January. Adeline only says so late in the meeting. What does that say about the order of the doors?

Ask who holds the admin login before she knows why you are asking and you get "our IT guy". Ask it fourth, with the teach-backs in between, and you get the name, the date and the fact she has been carrying alone. On the bench it is worth 3 points, and most orders never reach it.

Sources covered

What this session teaches, and where it came from

✓Five maturity level names: Initial/Ad hoc, Repeatable, Defined, Managed, OptimizedDAMA International, DAMA-DMBOK, 2nd ed., Technics Publications, 2017, ch. 15; reported from summaries. DMBOK has no level 0. The interview question beside each rung is ours, not DAMA's
✓50 percent to 80 percent of time collecting and preparing dataSteve Lohr, "For Big-Data Scientists, 'Janitor Work' Is Key Hurdle to Insights", The New York Times, 17 Aug 2014; quoted as a range, as printed
✓60 percent cleaning and organising, plus 19 percent collectingCrowdFlower, 2016 Data Science Report; two separate figures, never combined with Lohr's range into one number
◐Starting with data, scaling with data, leading with dataJoe Reis and Matt Housley, Fundamentals of Data Engineering, O'Reilly, 2022; reported from summaries, chapter not confirmed so none is cited
◐Single source of truth versus multiple versions of the truthLeandro DalleMule and Thomas H. Davenport, "What's Your Data Strategy?", Harvard Business Review, May-June 2017; reported, body paywalled
◐Harbourline and Adeline TanConstructed. The POS vendor, the Friday stock sheet, the WhatsApp orders, the loyalty vendor, Kenneth and the PDPA lawyer are typical, not sourced; every value is printed in the bench's bank file

Every fact on this page, and its verification tier, is recorded in the course's source map.

Session 2 cheat sheet · pin this

Three originsRecorded by a system, typed by a person, or not recorded anywhere. One question per number: "where does this come from, step by step?"
Typed on a FridayNo fresher than the typing, no more trusted than the checking. The first build is an agreed sheet with a checker.
Five rungs, five questionsWho fixes it · same way each week · written down · checked afterwards · better on its own. Names are DMBOK's; no rung 0.
Never the numberThe rung goes in your notes beside each source. A grade ends the conversation; the questions are the lesson.
Owner means who can say yesTo a change or an export. Usually a contract, not a login. Write a name or write "nobody", never a department.
The map goes firstBoxes, owners, one key, one lock, dashed arrows. Sent within a day with one line: "which box is wrong?"