learn-market-sizing-with-phoebe / Analyst session 6 of 6
Learn Market Sizing with Phoebe · Analyst session 6 of 6

The triangulation bench

One method gives a number. Two independent methods give a number and a check on it. Tonight the top-down chain from Analyst session 1 and the bottom-up chain from Analyst session 2 meet on one bench, computed in your browser: Japan's real household counts and tea spend on one side, Kettle & Co's constructed pilot on the other. The bench prints the gap between them, where their ranges overlap, and which single assumption explains most of the gap. Then it lets you break it twice: once with the hero assumption that turns every tea drinker into a customer, and once with an analyst-report number that arrives without a method.

🔴 Bench Data analysts and data scientists who build the size, and the leads who sign it off Hands-on in the browser 45 min
0-3 · Welcome 3-10 · Why two methods 10-35 · The bench, rung by rung, then break it 35-45 · Category toggle, Q&A
Part 0

Where we start

You arrive with a top-down chain (Analyst session 1), a bottom-up chain (Analyst session 2), ranges on every assumption and a tornado (Analyst session 4), and a healthy suspicion of anyone's planned share (Analyst session 5). The bench puts them together. Real rows: 34,553,907 two-or-more-person households from the 2020 Census and their tea spend from the Family Income and Expenditure Survey, 2023-2025 average. Constructed: every Kettle & Co share, price and frequency, and the analyst figure. Every number on this page is one the bench prints at its default settings; move a slider and your numbers will differ.

🎫 Clear all three quiz questions to stamp your passport Live = presented in the 45 minutes Self-study = the full depth, after class ★ Build-along = everyone works it through

★ What you walk out with tonight. A triangulated size for Kettle & Co with its gap, its overlap and the one assumption to measure next, written as three lines for the sizing brief; and two things you can now refuse on sight: a size whose two methods disagree tenfold because one of them counts every tea drinker, and a size nobody can triangulate because nobody knows how it was made.

Part 1 · covers why two methods, and what they check

Two chains, one market, and the link they share

7 min live

Top-down starts from the whole and narrows; bottom-up starts from your own customers and multiplies out. If they land near each other, each is evidence for the other. If they do not, the gap is the most useful number on the page, because it tells you which assumption to go and measure. But triangulation only checks what the two methods do not share.

TWO CHAINS FROM ONE SHARED LINK solid = real statistic · dashed = constructed Kettle & Co input · billion yen a year HOUSEHOLDS 34,553,907 shared, real x LEAF SPEND 5,737 yen a year real x PREMIUM 33% constructed x ONLINE 30% constructed TOP-DOWN 19.63 x BUY ONLINE 4.5% of households constructed x PER ORDER 2,400 yen constructed x ORDERS 3.5 a year constructed BOTTOM-UP 13.06 1.50x the gap Count one-person households too and both move, to 31.64 and 21.06. The gap stays 1.50x. A wrong input both methods share cancels in the ratio. Triangulation cannot see it.
🔍 Click to zoom - the amber box feeds both chains, so the gap is blind to it; check shared links some other way
LiveWhat "independent" has to mean4 min▶

Top-down here is households times survey spend times two shares. Bottom-up is households times the share that buys online times spend per order times orders a year. They share one link, the household count, and nothing else. Every other link comes from a different source: a government survey on top, Kettle & Co's own pilot underneath.

That is what makes the gap informative. If the survey spend were wrong, only the top-down would move. If the pilot's repeat rate were wrong, only the bottom-up would move. But if the household count were wrong, both would move together and the gap would not notice. Try it on the bench: switch the population to "all households" and both sizes rise, to 31.64 and 21.06, while the gap stays at 1.50x.

So the honest claim is narrow: "the two methods agree within 1.50x on everything they do not share". The shared link needs its own check, which for a Census count is reading the table carefully, as Analyst session 1 did.

Self-studyIs one method "the right one"? A disagreement worth teaching3 min▶

Practitioners disagree, and both sides have a point. One camp prefers bottom-up for any plan: it is built from things you can observe, customers, prices and repeat orders, and it scales with your actual go-to-market. Its critics answer that a bottom-up built from a pilot inherits the pilot's early adopters, who are rarely typical. Another camp trusts top-down because it rests on large official samples; its critics answer that the shares that narrow a top-down to your segment are usually guesses, as they are here.

The position taken on this bench is a working one, not a verdict: neither method is the answer alone, and the useful output is the gap plus the assumption that explains it. A team that only ever builds one method has no gap to learn from.

Build-along · the bench

The triangulation bench

★ 22 min · the main event

Work the four rungs in order and say out loud what changed. Then toggle the category. Then press the break button. Every tile is labelled: the top-down and the gap are modelled from real rows and constructed shares, the bottom-up is constructed end to end, and the analyst figure is constructed and has no method at all.

Read it in this order. The two ranges first, then the gap, then whether the ranges overlap, then the assumption that explains most of the gap. "Explains most" means: move that one input to the edge of its own range, in the direction that closes the gap, and see how much of the gap disappears, measured on a log scale. An input that closes 100 percent or more could, on its own, make the two methods agree.

THE LADDER, AS THE BENCH PRINTS IT billion yen a year, log scale · teal = top-down range · white = bottom-up range 1 · top-down only 19.63 · range 10.90 to 31.72 2 · bottom-up only 13.06 · range 7.11 to 21.55 3 · triangulated gap 1.50x · overlap 10.90 to 21.55 share bought online closes 76% 4 · hero, anti-lever 198.24 no overlap · gap 15.18x · best input closes 7% break · analyst number 50.00 · gap 3.83x · cannot close 5 10 20 50 100 200 The hero and analyst rows print a point, not a range: there is no assumption left to vary.
🔍 Click to zoom - only rung 3 has an amber overlap; both ways of breaking it push the top-down away from anything Kettle's own customers could confirm

Step 1 · Rung 1, top-down only. Press it. One method, one range: the chain from Analyst session 1. Nothing yet checks it.

★ Rung 1 · what the bench printstop-down range 10.90 to 31.72 billion yen a year (middle 19.63) verdict One method: 10.90 to 31.72 billion yen a year. Nothing yet checks it.

Step 2 · Rung 2, bottom-up only. Kettle & Co's pilot numbers from Analyst session 2: 4.5 percent of households buying the category online, 2,400 yen an order, 3.5 orders a year, each with its own low and high.

★ Rung 2 · what the bench printsbottom-up range 7.11 to 21.55 billion yen a year (middle 13.06) verdict One method: 7.11 to 21.55 billion yen a year, from Kettle & Co's own pilot. Nothing yet checks it.

Step 3 · Rung 3, triangulated. Both at once. Read the gap, the overlap, and which assumption explains most of the gap. Then open the tornado under the tiles: it is the same ranking drawn as bars.

★ Rung 3 · what the bench printsgap 1.50x (top-down middle / bottom-up middle) overlap 10.90 to 21.55 billion yen a year explains most share bought online: at the edge of its range it closes 76% of the gap then premium share 68% · households that buy online 49% orders a year 45% · spend per order 29%

Step 4 · Rung 4, the hero assumption. "Every tea drinker is our customer." The premium and online filters come off the top-down. Watch the top-down jump and the gap widen, and note that no single input inside its range can now close it.

Rung 4 · the anti-levertop-down 198.24 billion yen a year, a point (10.1 times rung 3) gap 15.18x · ranges do not overlap best single input closes 7% of the gap verdict the two methods are not sizing the same thing

Step 5 · Go back to rung 3, then press "Break it: use the analyst report number". The top-down is replaced by a constructed round figure from a report with no published method. Read what the bench can and cannot tell you now.

Break · the analyst numbertop-down replaced by 50.00 billion yen (constructed, no method) gap 3.83x explains most unknown: no method, so no assumption to compare verdict triangulation cannot close; there is no way to know which number is wrong

Step 6 · Your turn. Press "Go back to the method". Move the share bought online to where your own evidence puts it, then the premium share, and read the new gap and overlap. Write the three lines for the sizing brief. Your numbers will differ from the ones above as soon as you move a slider.

★ Step 6 · three lines for the briefsize: ____ to ____ billion yen a year (overlap of two methods) agreement: top-down and bottom-up within ____x on everything they do not share measure next: ____________________ (the input that explains most of the gap)
Part 2 · covers the gap and the hero assumption

Which assumption explains the gap, and what a hero does to it

6 min live

A gap is not a failure of either method. It is a pointer: somewhere in the five constructed inputs is the reason the two chains disagree. The bench ranks them by how much of the gap each one could close on its own, inside its own range. The hero assumption shows what happens when the reason is not an input at all, but a definition.

HOW MUCH OF THE GAP EACH INPUT CLOSES, AT THE EDGE OF ITS RANGE default settings, gap 1.50x · bar length to scale, 100% closes the whole gap share bought online premium share households buying online orders a year spend per order 76% 68% 49% 45% 29% 100% = closes it all HERO ASSUMPTION ON gap 15.18x best: households buying 7% nothing else comes close No single input closes the default gap alone; online share and premium share together are where to measure.
🔍 Click to zoom - at the default the top two bars are top-down shares; under the hero assumption those shares no longer exist, and what is left cannot close a 15x gap
LiveReading the ranking at the default3 min▶

The top two inputs are both top-down shares: share bought online closes 76 percent of the gap, premium share 68 percent. That is a finding, not a coincidence. Those two shares are the links nobody measured; the survey spend under them is real. The tornado in Analyst session 4 showed the same order: share bought online swings the gap from 1.10 to 2.00, the widest bar.

No input closes 100 percent on its own, but the ranges already overlap from 10.90 to 21.55, so the methods are consistent. The sizing brief should say so, and should name the share bought online as the input to measure before anyone commits a budget.

LiveThe hero assumption, in the engine's numbers3 min▶

"Every tea drinker is our customer" removes the premium and online filters. The top-down becomes households times all leaf spend: 198.24 billion yen a year, 10.1 times the triangulated top-down. The bottom-up does not move, because Kettle's pilot customers did not change. The gap becomes 15.18x, the ranges no longer overlap, and the best single input closes 7 percent.

That pattern, a gap no input can close, is the signature of two methods sizing two different things. It is what a TAM looks like when somebody puts it next to a bottom-up built from real customers. Business session 2 reads the same hero assumption on a pitch deck.

Real world

The board slide that said 198 billion. Kettle & Co's investor update led with "a 198 billion yen market". The analyst who built the bottom-up asked to put 13.06 on the same slide; the gap made the hero assumption visible in one glance, and the slide now leads with the triangulated range and names the share bought online as the open question. Constructed Kettle & Co example; the household and spend figures are real.

Part 3 · covers the category toggle and the number with no method

When the gap is a definition, and when it cannot be read at all

6 min live

Two more ways a gap stops being useful. The first is a category choice: change what market you are sizing and the top-down moves while your customers stay where they were. The second is a top-down nobody can open: a figure from a report that does not publish its method, which leaves nothing to triangulate against.

THE CATEGORY TOGGLE top-down middle vs the same bottom-up, 13.06 THE BREAK BUTTON a method you can open vs a number you cannot Premium loose-leaf · 19.63 gap 1.50x · ranges overlap Tea, all of it · 148.96 gap 11.40x · best input closes 13% Wellness drinks · 271.00 gap 20.75x · best input closes 10% homes spend prem. online every link can be argued with ? ANALYST FIGURE 50.00 · constructed no method published gap 3.83x · nothing to compare Left: the customers did not move, the definition did. Right: the gap exists, and nobody can say why.
🔍 Click to zoom - a gap you can explain is evidence; a gap you cannot open is only a disagreement between two people
LiveThe category toggle, against the same customers3 min▶

Switch the category on the bench. "Tea, all of it" adds bottled and canned tea drinks: top-down 148.96, gap 11.40x, and the best single input, share bought online, closes 13 percent. "Wellness drinks" adds mineral water, sports drinks and lactic acid drinks: 271.00, gap 20.75x, best input 10 percent. Premium loose-leaf: 19.63, gap 1.50x, ranges overlap.

The bottom-up never moved, because it is built from the customers Kettle actually has. So the category toggle is a test of the category: a frame whose top-down cannot be reconciled with your own customers by any input in range is a frame your customers are not in. That is evidence for marketing's positioning call in Business session 1, not a replacement for it.

LiveThe analyst number: why triangulation cannot close3 min▶

Press the break button and the top-down is replaced by a constructed 50.00 billion yen from a report that does not publish its method. The gap against the bottom-up is 3.83x. The bench cannot say which input explains it, because one side has no inputs: no population, no rate, no shares. Nobody can tell whether the report sized a wider category, a different year, a different channel, or made a mistake.

Analyst-firm market sizes are contested, and the disagreement is worth teaching straight. Some teams use them as an outside anchor: a figure from people who looked at the market for longer than you did. Others treat any figure without a published method as unusable, because category definitions vary between firms and the firm that sells the report has its own reasons to make the market look large. On the bench the practical rule is narrower and both camps accept it: a number without a method can sit beside a triangulated range as context, but it cannot be one side of the triangulation.

Self-studyThe population toggle: the check triangulation cannot make2 min▶

Set the population to "all households, one-person included" and read the bench: top-down 31.64 (range 17.58 to 51.13), bottom-up 21.06 (range 11.46 to 34.74), gap 1.50x, share bought online still explaining 76 percent. Everything bigger, nothing different. If the one-person assumption is wrong, the bench will never tell you, because both chains multiply by the same households. The defence is upstream: read the population of every table you use, as Analyst session 1 did.

Homework

Before you hand the size over

40 min
  1. Build both chains for your own market, top-down from an official table and bottom-up from your own customers, with a low and a high on every assumption.
  2. Compute the gap and the overlap. If the ranges do not overlap, find the single input that would close the most of the gap inside its range, and write how you would measure it.
  3. List every link the two chains share. For each one, write the check you made that does not depend on the other method.
  4. Find one market size from a report in your sector and write whether its method is published. If it is not, put it beside your range as context and write one sentence on why it is not one side of the triangulation.
Check yourself

Three questions

Clear all three and Analyst session 6 gets stamped in your passport.

1 · Switching to "all households" moves the top-down to 31.64 and the bottom-up to 21.06, and the gap stays 1.50x. What does that tell you?

Triangulation only checks what the two methods do not share. A shared link needs its own check, such as reading the survey's population.

2 · The hero assumption gives a top-down of 198.24, a gap of 15.18x, and the best single input closes 7 percent. What is the right reading?

A gap no input can close is a definition problem, not a measurement problem. The hero assumption inflated the top-down 10.1 times without any customer changing.

3 · A report says the market is 50.00 billion yen and publishes no method. The bench prints a gap of 3.83x and "cannot close". Why?

Triangulation compares methods, not numbers. A figure without a method can sit beside the range as context; it cannot be one side of the check.

Sources covered

What this session teaches, and where it came from

✓34,553,907 two-or-more-person households; 55,704,949 general householdsStatistics Bureau of Japan, 2020 Population Census, Basic Complete Tabulation on Population and Households, Table I-4-2; read at source
✓Leaf tea 5,737 yen, tea total 14,370 yen, wellness drinks items, per household a yearStatistics Bureau of Japan, Family Income and Expenditure Survey, two-or-more-person households, item ranking by prefectural capital and designated city, 2023-2025 average (drinks); read at source
✓The ladder: 19.63 (10.90 to 31.72); 13.06 (7.11 to 21.55); gap 1.50x, overlap 10.90 to 21.55, online 76%; hero 198.24, 10.1x, gap 15.18x, 7%; analyst 50.00, gap 3.83xComputed by the bench engine in your browser; a Python reference prints the same numbers to 2 decimal places; every Kettle & Co input and the analyst figure are constructed
✓Category toggle: 148.96 (11.40x, 13%), 19.63 (1.50x), 271.00 (20.75x, 10%); population toggle 31.64 and 21.06, gap 1.50xComputed by the bench engine on the same rows
◐Analyst-firm market sizes as an anchor or as unusableContested; taught as a disagreement, no firm named and no figure quoted

Every fact on this page, and its verification tier, is recorded in the course's source map.

Analyst session 6 cheat sheet · pin this

Two methods, one marketThe gap is the finding. 1.50x here, overlapping 10.90 to 21.55.
Explains mostThe one input that, at the edge of its range, closes most of the gap. Measure it next.
Shared links cancelA wrong household count moves both chains; the gap stays 1.50x.
No input closes it?Then the two methods size different things. Hero: 15.18x, best 7%.
Category is testableTea 11.40x, wellness 20.75x, premium loose-leaf 1.50x against the same customers.
No method, no triangleA report figure can be context, never one side of the check.