learn-ecommerce-metrics-with-phoebe / Analyst session 7 of 8
Learn Ecommerce Metrics with Phoebe · Analyst track · Session 7 of 8

The review pack

You can compute every Mango Lane number by hand (b2), walk the tree (b3), read the gates (b4), diagnose a drop (b5), and cut by segment (b6). Now you package it. The weekly review pack is four fixed pages that turn your arithmetic into the document a leadership room actually reads - the same document the leader track (a4) teaches leaders to expect. Today you assemble a full pack for a real week, cross-foot it, and write the one paragraph that answers the room's questions before they ask.

🟡 Analyst track Analysts · marketers · ops · founders Numbers to narrative 45 min
0-4 · Recap 4-15 · The four pages 15-38 · Build this week's pack 38-45 · Narrative + monthly
Part 0

Where this session sits

Sessions b2-b6 built your computing muscles. This session and the next build your shipping muscles: b7 turns the numbers into the weekly pack, b8 writes the spec sheet that keeps the numbers honest. On the leader side, a4 teaches the weekly business review ritual from the reader's chair - this session is the writer's chair for the exact same meeting.

Live - presented in session Self-study - read after class Sources covered
★ What you walk out with today The fixed four-page pack format (scorecard, gates, channels, narrative), one fully assembled and cross-footed pack for a week where Mango Lane's GMV fell 2%, and a narrative template that answers "what moved, why, what are we doing, when will we know" in one paragraph.
Part 1 · the format a4's leaders expect

Four pages, same order, every week 11 min live

A weekly pack works because it is boring in the right way: the same four pages in the same order every single week. Readers stop hunting for numbers and start noticing changes - which is the whole point. Page 1 is the scorecard (core four, WoW and YoY). Page 2 is the funnel gates (four gates, WoW). Page 3 is channels (GMV by channel, share, WoW). Page 4 is the narrative - one paragraph plus an actions table. Nothing else.

Page 1 · Scorecard The core four GMV · sessions CR · AOV each with WoW % and YoY % cross-foots to the GMV equation (a1) Page 2 · Funnel gates The four gates PDP penetration add-to-cart checkout start completion each with WoW % gates multiply to CR Page 3 · Channels GMV by channel organic · paid CRM · social GMV + share of total + WoW % per channel channel rows sum to page 1 GMV Page 4 · Narrative One paragraph: what moved · why what we are doing when we will know + actions table action · owner · date Same four pages, same order, every week. Readers stop hunting for numbers and start noticing changes.
🔍 Click to zoom - the weekly pack: scorecard, gates, channels, narrative
LiveWhy the order is fixed4 min▶

The order is a funnel of questions. Page 1 answers "how did we do" (the outcome). Page 2 answers "where in the journey did it happen" (the gates). Page 3 answers "which traffic did it come from" (the channels). Page 4 answers "so what" (the story and the actions). A reader who trusts pages 1-3 can skim straight to page 4; a reader who doubts page 4 can trace every claim back through 3, 2, 1. That two-way traceability is what makes a pack more than a screenshot dump.

Real world

Amazon's weekly business review runs on the same discipline: a fixed deck of metrics reviewed in the same order every week, so anomalies pop out by familiarity rather than by highlighting. You are building the small-store version - four pages instead of seventy, but the same principle: format stability is what makes change visible.

Self-studyWho reads which page3 min read▶

Each page has a natural first reader, and knowing who that is tells you how to write it:

  • Page 1 (scorecard) - the CEO and finance. They read the WoW and YoY columns first and the levels second. Round consistently; never change decimal places between weeks.
  • Page 2 (gates) - product and engineering. A gate that moved is their to-do list; a gate that held is their alibi.
  • Page 3 (channels) - marketing. Share tells them the mix, WoW tells them this week's fires.
  • Page 4 (narrative) - everyone, first. In practice the room reads page 4, then flips back to whichever page backs the claim they doubt. Write page 4 knowing it will be audited.
Demo 1 · everyone builds

Assemble this week's pack ★ 15 min · everyone works

The setup: Mango Lane just closed a soft week. To keep every number checkable, we use the canonical baseline you memorized in b1 as "last week" and these actuals as "this week": sessions 356,400 (-1.0%), session CR 2.673% (-1.0%), AOV flat at $68, so GMV lands at $647,741 (-2.0%). Build pages 1-3 now; page 4 (the narrative) is Demo 2.

LivePage 1 - the scorecard, cross-footed6 min▶
MetricLast weekThis weekWoWYoY
GMV$660,960$647,741-2.0%+9.9%
Sessions360,000356,400-1.0%+7.0%
Session CR2.700%2.673%-1.0%+1.5%
AOV$68.00$68.000.0%+1.2%
Orders (check row)9,7209,526-2.0%+8.6%

Orders = sessions x CR: 356,400 x 2.673% = 9,527 (9,526.6 - the pennies are rounding). Orders fell the same -2.0% as GMV because AOV held still.

GMV = orders x AOV: 9,526.6 x $68 = $647,741. Matches the headline. Page 1 agrees with itself.

Cross-foot the WoW: 0.99 (sessions) x 0.99 (CR) x 1.00 (AOV) = 0.9801, i.e. -2.0% GMV. Two small -1% dips multiply into the -2% headline. If your factor changes do not multiply back to the GMV change, a number on the page is wrong - find it before the room does.

YoY cross-foots too: 1.070 x 1.015 x 1.012 = 1.099, matching the +9.9% GMV YoY. Soft week, healthy year.

LivePage 2 - the funnel gates4 min▶
Gate (b4 definitions)Last weekThis weekWoW
PDP penetration (of all sessions)40.00%40.00%flat
Add-to-cart (of PDP sessions)25.00%24.75%-1.0%
Checkout start (of cart sessions)45.00%45.00%flat
Checkout completion (of checkout sessions)60.00%60.00%flat

Gates multiply to CR: 0.40 x 0.2475 x 0.45 x 0.60 = 0.02673 = 2.673% - exactly page 1's CR. The -1% CR dip lives entirely in one gate: add-to-cart.

Session counts confirm it: 356,400 x 40% = 142,560 PDP sessions; x 24.75% = 35,284 cart sessions; x 45% = 15,878 checkout sessions; x 60% = 9,527 orders. Same orders as page 1.

LivePage 3 - channels5 min▶
ChannelLast week GMVThis week GMVShareWoW
Organic$264,384$263,79740.7%-0.2%
Paid$198,288$197,89230.6%-0.2%
CRM$132,192$131,85320.4%-0.3%
Social$66,096$54,1998.4%-18.0%
Total$660,960$647,741100%-2.0%

Channel rows sum to the page 1 total: 263,797 + 197,892 + 131,853 + 54,199 = $647,741. Never ship a channel page that does not sum to the scorecard.

The story jumps off the page: three channels roughly flat, social down $11,897 (-18%) - which is nearly all of the $13,219 total GMV drop. b6's segment-cut instinct did its job: the average hid it, the cut found it.

Three channels flat, one channel down 18% Organic - 40.7% share -0.2% Paid - 30.6% share -0.2% CRM - 20.4% share -0.3% Social - 8.4% share -18.0% Social fell 18% (-$11,897) - nearly all of the week's total GMV drop; the other channels barely moved.
🔍 Click to zoom - one broken channel, not a broken store
Self-studyThe pre-ship checklist - three reconciliations3 min read▶

Before any pack leaves your hands, run the same three checks in the same order. They take two minutes and they catch almost everything:

All three checks pass? Ship the pack Numbers nobody re-derives Which check failed? Scorecard cross-foot Sessions x CR x AOV off Gates don't multiply One gate is stale (b8) Channels don't sum Untagged traffic hiding yes no A pack that reconciles for ten weeks straight earns the only thing that matters: trusted numbers.
🔍 Click to zoom - a pack that fails a reconciliation should never ship anyway

Cross-foot the scorecard. Sessions change x CR change x AOV change must reproduce the GMV change (0.99 x 0.99 x 1.00 = -2.0% this week). Rounding pennies are fine; a tenth of a percent is not.

Multiply the gates. The four gate rates on page 2 must multiply to page 1's CR (0.40 x 0.2475 x 0.45 x 0.60 = 2.673%). If they do not, one gate is stale or one denominator drifted (b8 territory).

Sum the channels. Page 3's rows must total page 1's GMV to the dollar. A gap means untagged traffic is hiding somewhere - find it or footnote it, never silently absorb it.

A pack that fails a reconciliation and ships anyway teaches the room to double-check you forever. A pack that reconciles for ten straight weeks earns the most valuable thing an analyst owns: numbers nobody re-derives.

Demo 2 · everyone writes

Page 4 - the narrative ★ 8 min · everyone works

The narrative is one paragraph in a fixed template: "What moved: [metric, size]. Why: [lever + slice + hypothesis]. What we are doing: [action + owner]. When we will know: [re-check date]." No adjectives, no throat-clearing, every claim traceable to pages 1-3.

LiveThe filled narrative for this week5 min▶
Real world

What moved: GMV fell 2.0% WoW to $647,741 (-$13.2k). Why: the drop is concentrated in the social channel, down 18% (-$11.9k) while other channels held roughly flat; the add-to-cart gate dipped 1% with it. Working hypothesis: a platform algorithm change cut our social reach - impressions on our top posts fell midweek. What we are doing: social lead is rebalancing creative toward formats the feed currently favors and shifting this week's boost budget to the two best-performing posts. When we will know: re-check social GMV and add-to-cart in next Friday's pack.

ActionOwnerCheck date
Rebalance social creative to favored formatsSocial leadNext Friday's pack
Shift boost budget to top 2 postsSocial leadNext Friday's pack
Confirm ATC dip is social-only (b6 cut by channel)AnalyticsWednesday
The whole trick The narrative answers the four questions before the room asks them. A leader reading page 4 should have nothing left to ask except "is the hypothesis right" - and the check date tells them when they will find out. If your paragraph invites the question "but why?", it is not done.
Self-studyNarrative anti-patterns - four ways page 4 goes wrong3 min read▶
  • The weather report. "GMV was down slightly this week amid softer traffic." Describes, explains nothing, commits to nothing. If a sentence could have been written without opening pages 2-3, delete it.
  • The victory lap with no denominator. "Social engagement was strong!" Strong against what? The narrative only speaks in the pack's specced metrics - engagement is not one of them.
  • The hypothesis stated as fact. Write "working hypothesis: platform algorithm change", not "the platform changed its algorithm". The re-check date is what upgrades a hypothesis to a finding.
  • The orphan action. An action with no owner or no check date is a wish. The actions table has three columns for a reason; a row missing any of them does not ship.
Part 4

Weekly vs monthly - what the bigger pack adds 5 min live

The weekly pack manages the run-rate; the monthly pack manages the direction. A monthly pack keeps the same four pages and adds four things: benchmarks (a5's tables - where does our CR sit against IRP and Littledata this month), the returning-customer trend (Shopify's returning customer rate over the last 6 months), the guardrail metrics (margin and return rate - the numbers that stop you celebrating GMV bought with discounts), and one deep dive (a single question worked properly, b5-style). And where the weekly compares WoW first, the monthly compares YoY primarily - month-over-month is too seasonal to trust (a5).

Self-studyPack hygiene - three rules that keep it alive3 min read▶
  • Freeze the format for a quarter. The pack's power is familiarity; a page that moves around resets everyone's pattern-matching to zero. Change format at quarter boundaries, announced.
  • Footnote any definition change. If a metric's definition changes mid-quarter (a6 governance), the pack carries a dated footnote on every affected page until the comparison periods are clean.
  • Never add a page without removing one. Packs die by accretion - every stakeholder wants their pet chart added and nobody ever asks to remove one. Four pages weekly is the budget. A new page must evict an old one.
Homework

Try it yourself - this week ◐ 20-30 min total

Sources

Sources this session draws on

The weekly pack is a craft pattern, not a certified standard - it is this course's small-store distillation of how disciplined ecommerce teams review their numbers. This page draws on:

◐Amazon-style weekly business review pattern - fixed metric deck, same order weekly, anomalies surface by familiarity (honest paraphrase of a widely described practice, not an official Amazon document)Part 1 · why the format is frozen
✓a4 - the weekly business review, the leader-track ritual this pack is written forInternal · reader's chair for this session
✓a5 - benchmarks and seasonality, the tables the monthly pack addsInternal · Part 4
✓a6 / b8 - metric governance: definition-change footnotes and the spec sheet behind every pack rowInternal · pack hygiene + next session
Check yourself

Three questions before you go 🎯 ◐ 90 seconds

1 · What is the weekly pack's page order, and why is it frozen?

Outcome, then where in the journey, then which traffic, then the story. Frozen format is the feature: familiarity is what makes an anomaly pop. A reshuffled pack resets everyone to hunting.

2 · Sessions fell 1%, CR fell 1%, AOV was flat. What GMV change should the scorecard show, and why?

GMV = sessions x CR x AOV, so changes multiply: 0.99 x 0.99 = 0.9801, about -2.0%. That is the cross-foot: if the scorecard's GMV change does not equal the product of its factor changes, a number is wrong.

3 · What must the page 4 narrative contain?

Four sentences, fixed template. It answers the room's four questions before they are asked; the pages behind it carry the numbers, the paragraph carries the meaning and the commitment to re-check.

Analyst session 7 cheat sheet · pin this

The four pages1 scorecard (core four, WoW + YoY) · 2 funnel gates · 3 channels · 4 narrative + actions. Same order, every week.
Why frozenFamiliarity makes anomalies pop. Change format only at quarter boundaries, announced.
Cross-foot ruleFactor changes multiply to the GMV change: 0.99 x 0.99 x 1.00 = -2.0%. If it does not multiply back, find the leak.
Sum ruleChannel rows sum to the scorecard GMV to the dollar. Gates multiply to the scorecard CR. Pages must agree.
Narrative templateWhat moved · why (lever + slice + hypothesis) · what we are doing (+ owner) · when we will know (re-check date).
This week's storyGMV -2.0%; social -18% (-$11.9k of the -$13.2k); hypothesis platform algorithm change; re-check Friday.
Monthly addsBenchmarks (a5), returning-customer trend, guardrails (margin, return rate), one deep dive. Compares YoY primarily.
Pack hygieneFreeze format a quarter · footnote definition changes (a6) · never add a page without removing one.