Where we start
You now have two sizes for the same market. Analyst session 1 built Kettle & Co's premium loose-leaf market from the top down: 19.63 billion yen a year at the middle of every assumption. Analyst session 2 built it from the bottom up: 13.06. Analyst session 3 covered the markets no table measures. Tonight neither number is allowed to travel alone. Each becomes a range, the range meets the decision threshold, and the gap between the two methods is taken apart one assumption at a time. Kettle & Co, its shares, pilot inputs and threshold are constructed; the households and the tea spend underneath the top-down are real rows from the Statistics Bureau of Japan.
★ What you walk out with tonight. A range sentence for Kettle & Co's sizing brief, both methods with their ranges and the threshold beside them, plus a ranked list of the five assumptions by how much each moves the gap, with one line on how you would narrow each. The top line of that list is your measurement plan for next week.
A point looks safe because it hides its own doubt
5 min liveBusiness session 1 asked the owner for a threshold before anyone sized anything: for Kettle & Co, entering Japan online is worth it at about 10 billion yen a year of SAM. That threshold is constructed for teaching. Against it, the point 19.63 looks like a comfortable yes. The ranges tell a different story.
LiveWhat the point hides, and what the line reveals3 min▶
The point. 19.63 billion yen a year is the top-down chain with every constructed share at its middle. It reads as twice the threshold. Nothing on the slide says that two of its four links are assumptions, or how far they could move.
The top-down range. Carry both shares to their lows together and to their highs together and the same chain prints 10.90 to 31.72. The whole range sits above a line at about 10, but the low end clears it by less than one billion yen, and "about 10" was never precise to the billion.
The bottom-up range. Built from Kettle & Co's own pilot inputs, the bottom-up prints 13.06 at the middle and 7.11 to 21.55 as a range. That range crosses the threshold. If the true value sits in its lower part, the decision is no.
So the honest answer to "go or no-go?" is neither. It is "measure more, and here is the one input to measure first". A range wholly above or below the threshold decides; a range across it tells you where to spend the next week.
Self-studyWhy "measure more" is a real answer, not a dodge2 min▶
Leaders sometimes hear a range as an analyst refusing to commit. Turn it around: a point that sits on the wrong side of the truth commits the business to a decision the evidence never supported. "Measure more" is only a dodge when it comes without a target. Paired with the tornado in Part 3, it becomes specific: which input, how wide it is today, and what a cheaper or better source would be.
It also tells you when to stop. Once a range sits wholly on one side of the threshold, further precision changes nothing about the decision, and the analyst can say so.
The slide that said "19.6". Kettle & Co's head of data presents 19.6 billion yen against a 10 billion line, and the room relaxes. The marketing lead asks what the low end is. Nobody knows. The rewritten slide shows both ranges and the line, and the meeting ends with a measurement plan instead of a launch date. Constructed Kettle & Co example.
Lows together, highs together, and what that does not tell you
5 min liveThe simplest honest range gives every assumption a low, a middle and a high, then carries them together: all lows for the bottom of the range, all middles for the point, all highs for the top. Those are the corners of the space of possible answers. They are easy to explain and deliberately wide.
LiveLow, middle, high, carried together3 min▶
Every constructed input gets three values, and each value gets a reason. For Kettle & Co's top-down: premium share of leaf spend 0.25 / 0.33 / 0.40, share bought online 0.22 / 0.30 / 0.40. For the bottom-up: households that buy the category online 3.5% / 4.5% / 5.5%, spend per order 2,100 / 2,400 / 2,700 yen, orders per buyer a year 2.8 / 3.5 / 4.2. All constructed.
The two real links, 34,553,907 households and 5,737 yen of leaf spend per household, keep their single value: they are measured, and the sampling error of the survey table is not published in the table used, so it is not quantified here. Carry the constructed lows together and the top-down prints 10.90; the highs together print 31.72; the middles print 19.63.
LiveThe limits of corners2 min▶
Wide on purpose. A corner is the case where every assumption missed the same way. That can happen, especially when one cause moves several inputs (a weak economy lowers premium share and orders together), but it is the edge of the possible, not the middle of the likely.
Silent on likelihood. A corner range says nothing about whether 12 is more plausible than 28. Do not draw a bell curve on top of it, and do not write "90 percent confident" next to it. Nobody measured a probability, so none goes on the page.
Self-studyAlternatives some teams prefer: scenarios and sampling3 min▶
Scenarios. Instead of mechanical corners, write two or three named stories, a cautious one and a bold one, each with inputs that belong together. A scenario keeps inputs coherent (a world where few households buy online is probably also one where online orders are less frequent), and leaders find stories easier to argue with than corners. The cost: the stories are chosen, so a team can choose comfortable ones.
Sampling, often called Monte Carlo. Give each input a distribution, draw thousands of combinations, and read off the spread of results. It shows which part of the box is crowded, which corners cannot. The cost is that it needs a distribution for every input and a view on how inputs move together, and the output is only as real as those choices. A percentile computed from invented distributions is still invented.
Neither is wrong. Some teams start with corners because they are transparent, then move to sampling once they have real data behind the input distributions. Others refuse sampling until then. Pick the method your evidence can support, and say which you picked.
The confidence interval nobody measured. An analyst at Kettle & Co runs a quick simulation with a normal distribution around every middle and reports a precise-looking probability that the market clears 10 billion. The BD lead quotes it to the board. Asked where the distributions came from, the analyst says they were defaults. The next version shows corners and the tornado, and says plainly that no probability has been measured yet. Constructed Kettle & Co example.
Which one assumption moves the gap most?
5 min liveCorners say how wide the answer is. Sensitivity says why. Move one input from its low to its high while every other input sits at its middle, record what happens, and repeat for each input. Here the thing measured is not either size but the gap between them: top-down divided by bottom-up, 1.50x at the middle. Sort the results widest first and you have a tornado.
LiveReading the five bars3 min▶
Why the gap, not the size. Each size on its own moves with every input. The gap between them is what tells you the two methods disagree, and an input that closes the gap is a candidate explanation for the disagreement. At the middle of every input the top-down is 1.50 times the bottom-up.
The order. Share bought online is widest: at its low the gap falls to 1.10, at its high it climbs to 2.00. Then premium share (1.14 to 1.82), households that buy online (1.93 at its low, 1.23 at its high), orders per buyer a year (1.88 to 1.25), and spend per order (1.72 to 1.34), the narrowest.
The direction. The two top-down inputs widen the gap as they rise, because they inflate the top-down. The three bottom-up inputs narrow it as they rise, because they inflate the bottom-up. Read the ends, not just the widths: a bar tells you which way the input would have to move to bring the methods together.
LiveWhy the widest bar is the next thing to measure2 min▶
Measurement costs time and money. The widest bar is where a better number buys the most: narrow the online share and the gap's possible spread shrinks more than for any other input. Narrowing spend per order, the narrowest bar, would barely move the conversation even if it were cheap.
Width is not the only test. Ask also how cheaply the input can be narrowed. If two bars are close in width and one can be checked from Kettle & Co's own orders table in an afternoon, do that one first. The tornado ranks impact; you add cost.
Self-studyThe caution: inputs that move together2 min▶
A tornado holds every other input at its middle. Real inputs do not always sit still while one moves. If the households that buy online are fewer than assumed, the ones who do buy may also buy more often, so two bottom-up bars could partly cancel. Or one cause could push several inputs the same way and the joint effect would be larger than any single bar.
One-at-a-time sensitivity cannot see either case. Use it to rank where to look, not to state the combined uncertainty; the corners in Part 2 and, if your evidence supports it, scenarios or sampling cover the joint movement.
Three weeks on the wrong input. Kettle & Co's analysts spend three weeks refining spend per order from pilot baskets, because the data was already in the warehouse. The tornado, drawn afterwards, shows it was the narrowest bar. A one-week retailer panel query on the online share would have moved the gap more. They now draw the tornado before choosing what to refine. Constructed Kettle & Co example.
Read the tornado and write the range sentence
★ 22 min · everyone buildsThe widget below computes the tornado in your browser from the same engine as the bench: the real survey rows and Census households under the top-down, Kettle & Co's constructed inputs on both sides. It runs at the default settings, premium loose-leaf and two-or-more-person households. Work the five steps and write down what it prints.
Step 1 · Read the gap at the middle. The verdict line above the bars says how many times larger the top-down is than the bottom-up when every input sits at its middle. Write it down; it is the centre line of every bar.
Step 2 · Read the widest bar and its two ends. The bars are sorted widest first. Copy the top bar's label and both ends, then say in your own words which direction the input has to move to bring the two methods closer.
Step 3 · Say which input to measure first, and why. Use the width ranking, then check cost. Copy the remaining four bars in order into the worksheet above and fill the last column with the cheapest honest way to narrow each.
Step 4 · Write the range sentence for the brief. Both methods, both ranges, the threshold, and the one input that would change the call. This sentence replaces the single number on the slide.
Step 5 · Note what changes on the bench. This tornado is drawn at the default settings. On the bench in Analyst session 6 the tornado is redrawn whenever you change the category, the population or an input, and the order of the bars can change with it.
Keep the sentence and the worksheet. The sentence goes into the sizing brief that Business session 3 hands to the owner; the worksheet becomes your measurement plan. Analyst session 5 asks the next question: even if the market is the size you think, how much of it can Kettle & Co realistically win?
Before Analyst session 5
30 min- Give every assumed link in your own sizing a low, a middle and a high, each with one line of reason. If you cannot write a reason for a low or a high, the range is a guess about a guess; say so.
- Ask the decision owner for the threshold in their own language, then place your range against it: wholly above, wholly below, or across.
- Draw a tornado by hand for your two or three widest assumptions: move each from low to high with the others at middle and record the result. Rank them.
- Write your range sentence in the step 4 format, ending with the one input you will measure next, how, and by when.
Three questions
Clear all three and Analyst session 4 gets stamped in your passport.
1 · The bottom-up range is 7.11 to 21.55 and the decision threshold is about 10 billion yen. Why is the honest answer "measure more"?
A range wholly above or below the line decides; a range across it tells you to narrow the input that moves it most before anyone commits.
2 · In the tornado, share bought online is the widest bar, gap 1.10 at its low and 2.00 at its high. What does that tell you?
Width ranks impact on the gap. Picking the value that makes the methods agree would be choosing the answer first; measuring it is the job.
3 · What is a limit of one-at-a-time sensitivity?
A tornado ranks where to look. Joint movement belongs to corners, scenarios or, with real distributions behind it, sampling.
What this session teaches, and where it came from
Every fact on this page, and its verification tier, is recorded in the course's source map.
Analyst session 4 cheat sheet · pin this
You can turn a size into a range, hold it against the threshold and name the input to measure first. Analyst session 5 asks whether the share in the plan is believable: adoption shape, distribution ceilings, and the collision test when every entrant's plan is added up against one market.