learn-data-warehouse-with-phoebe / Leader session 1 of 6
Learn Data Warehouse with Phoebe · Leader track · Session 1 of 6

Why a warehouse

Somebody on your team wants budget for "a data warehouse", and you are about to sign off on something you cannot picture. Six sessions fix that. The running example is Daybreak, a coffee-subscription brand whose app database just met its first real dashboard - badly. No code to write, ever: this track teaches the thinking, so you can fund, question, and steer the build with confidence.

🔵 Leader track Leaders: CxO · VPs · managers No code - thinking mode 45 min Start here
0-3 · Welcome 3-20 · Two workloads 20-42 · What a warehouse is + when not 42-45 · Q&A
Part 0

How this track works

Six 45-minute sessions that turn "data warehouse" from a budget line you nod at into a system you can reason about. Today: why warehouses exist at all, and - just as useful - when you should refuse to build one. Sessions ahead cover the shape of a warehouse (a2), why dashboards disagree and how to stop it (a3), the buy-vs-build landscape (a4), cost and risk (a5), and the questions to ask your data team (a6). Your builders have their own ten-session track where they actually construct Daybreak's warehouse; this track is the boardroom view of the same build.

Live - discussed in session Self-study - read after Boardroom moment - a story to retell Official sources covered
★ What you walk out with today The one distinction the entire field rests on (transactions vs analytics), a plain-English definition of a warehouse you can repeat in any meeting - "a governed copy of our data, restructured for big questions" - and the three signals that tell you whether your company actually needs one yet.
Part 1 · covers IBM DW Fundamentals M1, 365DS Foundations

The day the dashboard froze the checkout 17 min live

Daybreak's origin story, and probably your company's too. At 9am on promo day, marketing opened a "lifetime revenue by cohort" dashboard. That one question had to read every order ever placed - on the same database processing live checkouts. Carts spun, support lit up, and two very different kinds of work were suddenly fighting over one machine. Naming those two kinds is the whole foundation of this course.

The app lane · running the business thousands of tiny actions, all day take order charge card edit address each touches ONE customer's row · must be instant and safe this is the database your app was built on - and it is good at this The analytics lane · understanding it a few huge questions, whole history revenue by month churn by cohort each reads EVERY row, a few columns · must scan fast run this on the app lane and the checkout pays the price copy One machine, two opposite jobs - somebody always loses: · the big scan hogs the database the checkout needs - customers feel it first · and the app database's row-by-row design makes the big scan slow anyway A warehouse is a COPY of the app's data, restructured for the second shape of question.
🔍 Click to zoom - two lanes of work that want opposite database designs
LiveTwo shapes of question6 min

The industry names are OLTP and OLAP, and you only need the shapes, not the acronyms. Transactions (OLTP) are narrow and urgent: one customer, one row, right now - "show Ava her subscription", "take this order". Analytics (OLAP) is wide and patient: every customer, all of history, but only two or three fields - "average order value by month for two years". Same data, opposite access patterns.

  • The app database is tuned for the first shape: fast, safe, one-row surgery. That is exactly what running a business needs.
  • Your questions are the second shape: big scans that summarize. Boards, budgets, and forecasts all live here.
  • The conflict is physical, not organizational: no amount of process fixes a machine being asked to do both at once.
The meeting-ready version "Our app database answers 'what is happening to this customer right now'. Our leadership questions are 'what happened to all customers over all time'. Those want different machines."
LiveWhy "just add an index" fails5 min

When the dashboard is slow, the first engineering reflex is "add an index". Worth understanding why that reflex is wrong here, because it is the cheapest-looking option on the table. An index is like a book's index: brilliant for jumping to a few specific rows. But analytics does not want a few rows - it wants all of them, summed up. There is no index for "read everything and add it up"; the data's physical layout itself has to change, and that means a separate, restructured copy.

  • Indexes find needles. Analytics wants the whole haystack, weighed.
  • Every index also taxes the app: each new order now has to update the index too. You slow checkouts to speed a dashboard - the worst trade available.
  • The honest fix has a name: get analytics off the app database. That sentence is the birth certificate of every warehouse.
Real world

Boardroom moment. A CFO once asked why the team could not "just tune the queries" instead of funding a warehouse. The data lead answered: "We can tune a query from 40 seconds to 20. We cannot tune away the fact that it reads four years of orders on the machine taking today's." Budget approved in that meeting. The physics argument beats the tooling argument every time.

Self-studyWarehouse vs mart vs lake in one breath3 min read

Three terms your team will use interchangeably in front of you. They are not interchangeable:

  • Data warehouse: the structured, governed copy of your data, modeled for analytics. The center of gravity, and of this course.
  • Data mart: a slice of the warehouse served to one team - a finance mart, a marketing mart. Marts come from the warehouse, not instead of it.
  • Data lake: cheap storage for raw files of any shape - useful, but ungoverned by default. The "lakehouse" hybrid appears in session a4's landscape tour.

Handy test: if someone proposes "a lake instead of a warehouse" for your KPI reporting, ask who is responsible for making the numbers in it trustworthy. The silence is the answer.

Part 2 · covers IBM DW Fundamentals M1, DLAI Data Engineering C4 serving framing

What a warehouse actually is 12 min live

Strip the vendor gloss and a warehouse is three moves: extract data out of the systems that run the business, restructure it for big questions, and point every dashboard at the copy. That last clause is the strategic one - it is what makes "single source of truth" more than a poster slogan. Not fully true in practice (session a3 is about why), but the ambition shapes everything.

Source systems app database payments ad platforms each keeps running the business, untouched extract The warehouse one governed copy cleaned · typed restructured for scans history kept rebuilt on a schedule - minutes to hours behind live serve Marts finance mart marketing mart per-team slices, same underlying truth Consumers dashboards AI & models every consumer reads the copy, never the app The strategic move: point EVERY dashboard at the copy - the app goes back to serving customers.
🔍 Click to zoom - extract, restructure, serve: the whole warehouse idea on one strip
LiveThe copy is a feature, not overhead4 min

Executives often flinch at "we will maintain a second copy of all our data" - it sounds like waste. Reframe it: the copy is where every property analytics needs but the app cannot afford gets added.

  • The copy can be restructured for scanning without slowing a single checkout.
  • The copy can keep history: the app overwrites a customer's plan when it changes; the warehouse remembers what it was last quarter - which is the only way "how did upgrades trend" is answerable.
  • The copy can be governed: tested, documented, access-controlled. You cannot bolt audit discipline onto a live production database; you can build it into the copy.
  • The copy is safely behind live - minutes to hours, by design. For "how did June go", that lag costs nothing.
LiveWhat it costs to run4 min

The number that surprises leaders in both directions: storing the copy is nearly free - cloud storage is pennies per gigabyte per month. The real bill is elsewhere.

  • Compute: modern warehouses charge when queries run. A well-run setup costs little; an unmanaged one - dashboards refreshing every 5 minutes, analysts scanning everything - burns quietly. Session a5 covers the levers.
  • People: the pipelines that feed the warehouse need building and tending. This is usually the largest line item and the one most often left out of the pitch.
  • The honest framing: you are not buying a product, you are standing up a small capability. Budget for the team, not just the tool.
Real world

Boardroom moment. Daybreak's founder asked the classic question: "Why does the data cost so little to store and so much to have?" The data lead's answer is worth stealing: "Storage is the parking. Compute is the fuel. Salaries are the drivers. You approved the parking and are surprised by the drivers." Every warehouse budget review since has used those three lines.

Part 3 · the discipline to say not yet

When you do NOT need one 10 min live

The strongest credibility move a leader can make in this space is knowing when to say no. A warehouse is a capability with a payroll attached - and plenty of companies bought one two years before they needed it. Here is the honest decision rule.

LiveThe "not yet" profile5 min

If this describes your company, a warehouse is premature:

  • One analyst, modest data: a read-only copy of the app database - or a single-file tool like DuckDB on an export - answers every question you have, today, for almost nothing.
  • Questions are still ad hoc: nobody is checking the same number weekly. Warehouses shine when questions repeat; one-off curiosity is cheaper served by hand.
  • No one owns definitions yet: if "active customer" means three things in three meetings, a warehouse will faithfully industrialize the confusion. Fix the vocabulary first (that is session a3's agenda).
The question to ask your team "What breaks if we wait six months?" If the answer is a shrug, wait. If the answer is specific and painful, keep reading.
LiveThe three buy signals5 min

Three signals, any two of which mean the conversation is overdue:

  • Dashboards are timing out or - worse - slowing the product, like Daybreak's frozen checkout. The physics has arrived.
  • Metric disputes are recurring: two teams bring two versions of the same number to the same meeting, monthly. You are paying a truth tax in executive hours.
  • Compliance or audit asks for lineage - "show us where this number came from" - and the honest answer is a chain of spreadsheets and one analyst's memory.
Real world

Boardroom moment. Daybreak hit signal one and three in the same quarter: the frozen-checkout incident, then a payment partner's due-diligence team asking how refund numbers were produced. The board memo that unlocked the budget was one paragraph long and contained no technology words at all - just those two stories and a cost line.

Self-studyMake vs buy - a preview of a43 min read

Once "do we need one" becomes yes, the next meeting is "which one" - and that is a landscape of cloud platforms (Snowflake, BigQuery, Redshift, Databricks and friends) plus a build-it-lean open-source path. Session a4 walks the landscape properly. For now, three anchors to resist vendor gravity:

  • The concepts in this track transfer everywhere: every vendor sells the same core idea you just learned - a governed, scan-shaped copy.
  • Your leverage is highest before a contract is signed, not after. Arrive at a4 with your requirements, not their demo script.
  • Migration is expensive; concepts are portable. Bet accordingly.
Homework

Before next session ◐ 20-30 min total

Source material

Official sources covered

This track distills the leadership-relevant core of the major data-warehousing curricula - the parts an executive actually needs, minus the labs. This session covers:

IBM Data Warehouse Fundamentals (Coursera) - Module 1: warehouses, marts, lakes overviewParts 1-2 + self-study card · the systems tour continues in a4
365DS Intro to Data Warehousing - FoundationsParts 1-3 · OLTP vs OLAP and why the copy exists
DeepLearning.AI Data Engineering C4 (Joe Reis) - serving framingPart 2 · "analytics is a serving problem"; architecture depth lands in a2
Check yourself

Three questions before you go 🎯 ◐ 90 seconds

1 · Which question is warehouse-shaped (OLAP), not app-shaped (OLTP)?

Warehouse questions scan all rows but few columns - every order, two fields, summarized. One-row lookups and edits are the app database's home turf.

2 · The dashboard is slow and it is dragging the product down with it. Why is "just add an index" the wrong fix?

There is no index for "read everything and sum it". The layout itself must change, which means a separate restructured copy - the warehouse.

3 · Your company: one analyst, small data, no repeated weekly questions, no metric disputes. The right move is...

A warehouse is a capability with a payroll. Without the buy signals - timeouts, recurring metric disputes, compliance asks - you are industrializing questions nobody is asking yet.

Leader session 1 cheat sheet · pin this

Two shapesApp questions: one row, right now. Leadership questions: all rows, all history, few columns. Opposite designs.
A warehouse isa governed COPY of your data, restructured for big questions - not a faster app database.
Why a copyThe copy can be scan-shaped, keep history, and carry governance - without slowing one checkout.
Why not an indexIndexes find few rows; analytics reads all rows. And every index taxes every app write.
The cost truthStorage is pennies. Compute and people are the bill. Budget the team, not just the tool.
Not yet, ifone analyst + small data + no repeated questions. A read-only copy covers it for almost nothing.
Buy signalsDashboards timing out · recurring metric disputes · compliance asking for lineage. Two of three = overdue.
Warehouse / mart / lakeGoverned copy / per-team slice of it / raw file storage. Marts come FROM the warehouse.