learn-market-sizing-with-phoebe / Analyst session 4 of 6
Learn Market Sizing with Phoebe · Analyst session 4 of 6

Ranges, not points

A market size is evidence for a decision, and a single number is the weakest form that evidence can take: it hides which assumptions it rests on and how far each could be wrong. Tonight the size becomes a range, the range is held up against the line where the decision flips, and a tornado chart shows which one assumption moves the answer most. That bar is the next thing to measure, and saying so is the most useful sentence an analyst can put in a sizing brief.

🟡 Analyst Data analysts and data scientists who build the size Hands-on in the browser 45 min
0-3 · Welcome 3-18 · Points, corners, the tornado 18-40 · Build-along: read the tornado 40-45 · Q&A
Part 0

Where we start

You now have two sizes for the same market. Analyst session 1 built Kettle & Co's premium loose-leaf market from the top down: 19.63 billion yen a year at the middle of every assumption. Analyst session 2 built it from the bottom up: 13.06. Analyst session 3 covered the markets no table measures. Tonight neither number is allowed to travel alone. Each becomes a range, the range meets the decision threshold, and the gap between the two methods is taken apart one assumption at a time. Kettle & Co, its shares, pilot inputs and threshold are constructed; the households and the tea spend underneath the top-down are real rows from the Statistics Bureau of Japan.

🎫 Clear all three quiz questions to stamp your passport Live = presented in the 45 minutes Self-study = the full depth, after class ★ Build-along = everyone works it through

★ What you walk out with tonight. A range sentence for Kettle & Co's sizing brief, both methods with their ranges and the threshold beside them, plus a ranked list of the five assumptions by how much each moves the gap, with one line on how you would narrow each. The top line of that list is your measurement plan for next week.

Part 1 · covers why a point is the wrong answer

A point looks safe because it hides its own doubt

5 min live

Business session 1 asked the owner for a threshold before anyone sized anything: for Kettle & Co, entering Japan online is worth it at about 10 billion yen a year of SAM. That threshold is constructed for teaching. Against it, the point 19.63 looks like a comfortable yes. The ranges tell a different story.

ONE POINT, TWO RANGES, ONE LINE billion yen a year · dashed = built on constructed inputs threshold, about 10 (constructed) ONE POINT 19.63 top-down middle: looks like a clear yes TOP-DOWN RANGE 10.90 clears the line by under 1 bn 31.72 BOTTOM-UP RANGE 7.11 middle 13.06 21.55 crosses the line: measure more 0 10 20 30 The point says yes. The ranges say: the bottom-up crosses the line and the top-down barely clears it.
🔍 Click to zoom - the threshold turns a range into a decision; a range across it is an instruction to measure, not a failure
LiveWhat the point hides, and what the line reveals3 min▶

The point. 19.63 billion yen a year is the top-down chain with every constructed share at its middle. It reads as twice the threshold. Nothing on the slide says that two of its four links are assumptions, or how far they could move.

The top-down range. Carry both shares to their lows together and to their highs together and the same chain prints 10.90 to 31.72. The whole range sits above a line at about 10, but the low end clears it by less than one billion yen, and "about 10" was never precise to the billion.

The bottom-up range. Built from Kettle & Co's own pilot inputs, the bottom-up prints 13.06 at the middle and 7.11 to 21.55 as a range. That range crosses the threshold. If the true value sits in its lower part, the decision is no.

So the honest answer to "go or no-go?" is neither. It is "measure more, and here is the one input to measure first". A range wholly above or below the threshold decides; a range across it tells you where to spend the next week.

Self-studyWhy "measure more" is a real answer, not a dodge2 min▶

Leaders sometimes hear a range as an analyst refusing to commit. Turn it around: a point that sits on the wrong side of the truth commits the business to a decision the evidence never supported. "Measure more" is only a dodge when it comes without a target. Paired with the tornado in Part 3, it becomes specific: which input, how wide it is today, and what a cheaper or better source would be.

It also tells you when to stop. Once a range sits wholly on one side of the threshold, further precision changes nothing about the decision, and the analyst can say so.

Real world

The slide that said "19.6". Kettle & Co's head of data presents 19.6 billion yen against a 10 billion line, and the room relaxes. The marketing lead asks what the low end is. Nobody knows. The rewritten slide shows both ranges and the line, and the meeting ends with a measurement plan instead of a launch date. Constructed Kettle & Co example.

Part 2 · covers ranges as corners, and their limits

Lows together, highs together, and what that does not tell you

5 min live

The simplest honest range gives every assumption a low, a middle and a high, then carries them together: all lows for the bottom of the range, all middles for the point, all highs for the top. Those are the corners of the space of possible answers. They are easy to explain and deliberately wide.

THE TOP-DOWN RANGE AS A BOX OF TWO ASSUMPTIONS share bought online (constructed) 0.40 high 0.30 mid 0.22 low 0.25 low 0.33 mid 0.40 high premium share of leaf spend (constructed) all low: 10.90 all high: 31.72 all middle: 19.63 mixed corner mixed corner CORNERS ARE DELIBERATELY WIDE a corner needs every input wrong in the same direction at once real misses are usually mixed, so the truth rarely sits in a corner the bottom-up has three inputs: a cube, same idea Corners say how far the answer could go. They say nothing about how likely each part of the box is.
🔍 Click to zoom - the range is the distance between two corners; the interior holds every mixed case, and nothing here says which is likely
LiveLow, middle, high, carried together3 min▶

Every constructed input gets three values, and each value gets a reason. For Kettle & Co's top-down: premium share of leaf spend 0.25 / 0.33 / 0.40, share bought online 0.22 / 0.30 / 0.40. For the bottom-up: households that buy the category online 3.5% / 4.5% / 5.5%, spend per order 2,100 / 2,400 / 2,700 yen, orders per buyer a year 2.8 / 3.5 / 4.2. All constructed.

The two real links, 34,553,907 households and 5,737 yen of leaf spend per household, keep their single value: they are measured, and the sampling error of the survey table is not published in the table used, so it is not quantified here. Carry the constructed lows together and the top-down prints 10.90; the highs together print 31.72; the middles print 19.63.

LiveThe limits of corners2 min▶

Wide on purpose. A corner is the case where every assumption missed the same way. That can happen, especially when one cause moves several inputs (a weak economy lowers premium share and orders together), but it is the edge of the possible, not the middle of the likely.

Silent on likelihood. A corner range says nothing about whether 12 is more plausible than 28. Do not draw a bell curve on top of it, and do not write "90 percent confident" next to it. Nobody measured a probability, so none goes on the page.

Self-studyAlternatives some teams prefer: scenarios and sampling3 min▶

Scenarios. Instead of mechanical corners, write two or three named stories, a cautious one and a bold one, each with inputs that belong together. A scenario keeps inputs coherent (a world where few households buy online is probably also one where online orders are less frequent), and leaders find stories easier to argue with than corners. The cost: the stories are chosen, so a team can choose comfortable ones.

Sampling, often called Monte Carlo. Give each input a distribution, draw thousands of combinations, and read off the spread of results. It shows which part of the box is crowded, which corners cannot. The cost is that it needs a distribution for every input and a view on how inputs move together, and the output is only as real as those choices. A percentile computed from invented distributions is still invented.

Neither is wrong. Some teams start with corners because they are transparent, then move to sampling once they have real data behind the input distributions. Others refuse sampling until then. Pick the method your evidence can support, and say which you picked.

Real world

The confidence interval nobody measured. An analyst at Kettle & Co runs a quick simulation with a normal distribution around every middle and reports a precise-looking probability that the market clears 10 billion. The BD lead quotes it to the board. Asked where the distributions came from, the analyst says they were defaults. The next version shows corners and the tornado, and says plainly that no probability has been measured yet. Constructed Kettle & Co example.

Part 3 · covers sensitivity and the tornado

Which one assumption moves the gap most?

5 min live

Corners say how wide the answer is. Sensitivity says why. Move one input from its low to its high while every other input sits at its middle, record what happens, and repeat for each input. Here the thing measured is not either size but the gap between them: top-down divided by bottom-up, 1.50x at the middle. Sort the results widest first and you have a tornado.

THE TORNADO: THE GAP, ONE INPUT AT A TIME gap = top-down / bottom-up · each bar runs from the input's low to its high, others at middle gap at the middle: 1.50x online share (top-down) premium share (top-down) buyers (bottom-up) orders a year (bottom-up) spend per order (bottom-up) low 1.10 · high 2.00 low 1.14 · high 1.82 low 1.93 · high 1.23 low 1.88 · high 1.25 low 1.72 · high 1.34 1.10 1.50 2.00 gap, log scale · 1.00 would mean the two methods agree Widest bar first: the share bought online alone moves the gap from 1.10 to 2.00. Measure it before anything else.
🔍 Click to zoom - bottom-up bars point the other way: raising a bottom-up input shrinks the gap, raising a top-down input widens it
LiveReading the five bars3 min▶

Why the gap, not the size. Each size on its own moves with every input. The gap between them is what tells you the two methods disagree, and an input that closes the gap is a candidate explanation for the disagreement. At the middle of every input the top-down is 1.50 times the bottom-up.

The order. Share bought online is widest: at its low the gap falls to 1.10, at its high it climbs to 2.00. Then premium share (1.14 to 1.82), households that buy online (1.93 at its low, 1.23 at its high), orders per buyer a year (1.88 to 1.25), and spend per order (1.72 to 1.34), the narrowest.

The direction. The two top-down inputs widen the gap as they rise, because they inflate the top-down. The three bottom-up inputs narrow it as they rise, because they inflate the bottom-up. Read the ends, not just the widths: a bar tells you which way the input would have to move to bring the methods together.

LiveWhy the widest bar is the next thing to measure2 min▶

Measurement costs time and money. The widest bar is where a better number buys the most: narrow the online share and the gap's possible spread shrinks more than for any other input. Narrowing spend per order, the narrowest bar, would barely move the conversation even if it were cheap.

Width is not the only test. Ask also how cheaply the input can be narrowed. If two bars are close in width and one can be checked from Kettle & Co's own orders table in an afternoon, do that one first. The tornado ranks impact; you add cost.

Self-studyThe caution: inputs that move together2 min▶

A tornado holds every other input at its middle. Real inputs do not always sit still while one moves. If the households that buy online are fewer than assumed, the ones who do buy may also buy more often, so two bottom-up bars could partly cancel. Or one cause could push several inputs the same way and the joint effect would be larger than any single bar.

One-at-a-time sensitivity cannot see either case. Use it to rank where to look, not to state the combined uncertainty; the corners in Part 2 and, if your evidence supports it, scenarios or sampling cover the joint movement.

Real world

Three weeks on the wrong input. Kettle & Co's analysts spend three weeks refining spend per order from pilot baskets, because the data was already in the warehouse. The tornado, drawn afterwards, shows it was the narrowest bar. A one-week retailer panel query on the online share would have moved the gap more. They now draw the tornado before choosing what to refine. Constructed Kettle & Co example.

Build-along

Read the tornado and write the range sentence

★ 22 min · everyone builds

The widget below computes the tornado in your browser from the same engine as the bench: the real survey rows and Census households under the top-down, Kettle & Co's constructed inputs on both sides. It runs at the default settings, premium loose-leaf and two-or-more-person households. Work the five steps and write down what it prints.

THE MEASUREMENT WORKSHEET, RANKED BY BAR WIDTH every value constructed for Kettle & Co · the last column is your plan input low mid high how we would narrow it 1st share bought online 0.22 0.30 0.40 retailer panel split by sales channel premium share of leaf spend 0.25 0.33 0.40 price-tier count of leaf listings households that buy online 3.5% 4.5% 5.5% pilot reach against an online panel orders per buyer a year 2.8 3.5 4.2 repeat orders in the pilot orders table spend per order 2,100 2,400 2,700 yen pilot basket sizes Constructed inputs and constructed narrowing ideas. The row order comes from the tornado.
🔍 Click to zoom - a tornado is only finished when every bar has a plan beside it, and the top plan has a date

Step 1 · Read the gap at the middle. The verdict line above the bars says how many times larger the top-down is than the bottom-up when every input sits at its middle. Write it down; it is the centre line of every bar.

★ Step 1 · what the widget printsGap at the middle of every input: top-down is 1.50 times bottom-up. top-down middle 19.63 bn yen a year bottom-up middle 13.06 bn yen a year

Step 2 · Read the widest bar and its two ends. The bars are sorted widest first. Copy the top bar's label and both ends, then say in your own words which direction the input has to move to bring the two methods closer.

★ Step 2 · the widest barShare bought online (top-down) gap 1.10 at low, 2.00 at high read: if the true online share is near its low, the two methods nearly agree; near its high, the top-down is twice the bottom-up

Step 3 · Say which input to measure first, and why. Use the width ranking, then check cost. Copy the remaining four bars in order into the worksheet above and fill the last column with the cheapest honest way to narrow each.

★ Step 3 · the measurement order1 share bought online 1.10 / 2.00 measure first: widest bar 2 premium share 1.14 / 1.82 3 buyers 1.93 / 1.23 4 orders a year 1.88 / 1.25 5 spend per order 1.72 / 1.34 narrowest: refine last why first: ____________________________________________

Step 4 · Write the range sentence for the brief. Both methods, both ranges, the threshold, and the one input that would change the call. This sentence replaces the single number on the slide.

★ Step 4 · the range sentence"Premium loose-leaf tea bought online in Japan: top-down 19.63 bn yen a year (10.90 to 31.72), bottom-up 13.06 (7.11 to 21.55). Against a threshold of about 10 bn, the bottom-up range crosses the line, so the answer is: measure more. The input that moves the gap most is the share bought online (gap 1.10 to 2.00); we will narrow it by ________ by ________."

Step 5 · Note what changes on the bench. This tornado is drawn at the default settings. On the bench in Analyst session 6 the tornado is redrawn whenever you change the category, the population or an input, and the order of the bars can change with it.

★ Step 5 · a note for Analyst session 6tornado at the defaults: online share widest, spend per order narrowest on the bench, after changing settings: your numbers will differ check: does the widest bar stay the same? ________

Keep the sentence and the worksheet. The sentence goes into the sizing brief that Business session 3 hands to the owner; the worksheet becomes your measurement plan. Analyst session 5 asks the next question: even if the market is the size you think, how much of it can Kettle & Co realistically win?

Homework

Before Analyst session 5

30 min
  1. Give every assumed link in your own sizing a low, a middle and a high, each with one line of reason. If you cannot write a reason for a low or a high, the range is a guess about a guess; say so.
  2. Ask the decision owner for the threshold in their own language, then place your range against it: wholly above, wholly below, or across.
  3. Draw a tornado by hand for your two or three widest assumptions: move each from low to high with the others at middle and record the result. Rank them.
  4. Write your range sentence in the step 4 format, ending with the one input you will measure next, how, and by when.
Check yourself

Three questions

Clear all three and Analyst session 4 gets stamped in your passport.

1 · The bottom-up range is 7.11 to 21.55 and the decision threshold is about 10 billion yen. Why is the honest answer "measure more"?

A range wholly above or below the line decides; a range across it tells you to narrow the input that moves it most before anyone commits.

2 · In the tornado, share bought online is the widest bar, gap 1.10 at its low and 2.00 at its high. What does that tell you?

Width ranks impact on the gap. Picking the value that makes the methods agree would be choosing the answer first; measuring it is the job.

3 · What is a limit of one-at-a-time sensitivity?

A tornado ranks where to look. Joint movement belongs to corners, scenarios or, with real distributions behind it, sampling.

Sources covered

What this session teaches, and where it came from

✓34,553,907 two-or-more-person households; 5,737 yen of leaf tea per household a yearStatistics Bureau of Japan, 2020 Population Census, Table I-4-2 (by subtraction), and Family Income and Expenditure Survey, two-or-more-person households, 2023-2025 average (drinks); read at source
✓Ranges and tornado: top-down 19.63 (10.90 to 31.72); bottom-up 13.06 (7.11 to 21.55); gap 1.50x; bars 1.10 / 2.00, 1.14 / 1.82, 1.93 / 1.23, 1.88 / 1.25, 1.72 / 1.34Computed by the widget engine at the default settings; the premium, online, buyer, order and spend inputs are constructed
✓Decision threshold, about 10 billion yen a year of SAMConstructed for Kettle & Co in Business session 1
◐Scenarios and sampling (Monte Carlo) as alternatives to cornersPrinciple only; no probabilities or percentiles are computed or quoted

Every fact on this page, and its verification tier, is recorded in the course's source map.

Analyst session 4 cheat sheet · pin this

Write the threshold firstA range above or below it decides. Across it: measure more.
A point hides its doubt19.63 looks safe; 7.11 to 21.55 crosses a line at about 10.
Corners: lows and highs togetherDeliberately wide, silent on likelihood. Never add an unmeasured probability.
Tornado on the gapOne input low to high, others at middle. Gap 1.50x at the centre.
Widest bar firstShare bought online, 1.10 to 2.00. Then weigh the cost to narrow it.
One at a time is a rankingIt cannot see inputs moving together. Use corners or scenarios for that.