How this session works
Five sessions ago the warehouse was a copy of the app database for dashboards. Today we finish the picture: the same governed tables now feed machine learning, AI agents, and the operational tools your teams live in. The stakes changed with the customers - a wrong number on a dashboard misleads one meeting; a wrong number inside an AI system misleads every conversation it has, confidently. Then we close the track with a roadmap you can put on one slide.
The warehouse's new customers 8 min live
Joe Reis's data engineering curriculum makes a point most AI strategy decks skip: serving is the last mile of data engineering, and analytics is only one of its destinations. The same warehouse now serves four customers - and the newest ones are the least forgiving of bad data, because they never pause to ask "does this look right?"
LiveWhy AI raises the stakes on data quality4 min▶
A dashboard has a built-in safety net: a human looks at it. When the churn number looks weird, someone says so before the board sees it. AI systems remove that net. A model trained on mislabeled subscriptions learns the mistake. An agent answering from a warehouse where "revenue" still has two definitions (the a3 problem) picks one at random and answers fluently. The failure mode of AI on bad data is not silence - it is confident wrongness at scale.
- ML features: models consume warehouse tables as ingredients - "days since last order", "orders per month". Wrong ingredients, wrong predictions, discovered months later in the metrics.
- AI agents and RAG: assistants ground their answers in your data. The grounding is only as good as the definitions and freshness underneath - a1 to a3 were secretly your AI-readiness sessions.
- Reverse ETL: warehouse scores flow back into CRM and support tools, where frontline staff act on them directly. The warehouse stops describing the business and starts steering it.
The copilot that failed its demo. A retail exec team piloted an AI assistant over their data. First question: "what was revenue last quarter?" The agent answered with the finance definition; the CFO had the product-dashboard number in hand; the two differed by the familiar refund gap. The pilot was paused - not because the AI was weak, but because the warehouse had never settled one definition of revenue. Six months of definition work later, the same assistant passed. The AI project was a warehouse project wearing a costume.
Self-studyViews and materialized views: how serving actually happens2 min read▶
One mechanism from the DLAI curriculum worth knowing by name. A view is a saved question - "active subscribers" defined once, referenced everywhere, so every consumer inherits the same definition. A materialized view is that same question with the answer pre-computed and stored (a5's lever 3). Together they are how one definition serves all four customers consistently: the dashboard, the model, and the agent all read "active subscribers" from the same governed shelf. Builder session b7 constructs these for Daybreak.
Self-studyDaybreak's four customers, concretely3 min read▶
The abstract map, made specific with our running case:
- Dashboard: the founder's Monday view - revenue by month, churn by cohort. The classic customer from a1, still the workhorse.
- ML feature: the churn model reads "days since last order" and "orders per month" from warehouse tables to score every subscriber weekly. If order dates are wrong upstream, the model quietly learns nonsense.
- AI agent: the support assistant answering "what plan is this customer on, and what did they last order?" from governed tables. Wrong data here reaches a customer's ears in seconds.
- Reverse ETL: the churn scores flow back into the support desk, so agents see "high churn risk" next to the ticket. The warehouse now steers frontline behavior, not just meetings.
One warehouse, four exits. Every exit inherits whatever quality - or whatever mess - lives in the tables.
Real-time, priced honestly 8 min live
Every vendor demo now ends with "and it's real-time". Here is the executive calibration: real-time is a genuine capability with a genuine price, and most business decisions are perfectly served by yesterday's data. The question is never "can we be real-time?" - it is "which decision, exactly, changes if this number is 5 minutes old instead of 24 hours old?"
LiveThe freshness ladder: match latency to the decision4 min▶
Think in three rungs, each roughly an order of magnitude more expensive to operate than the one below:
- Daily batch (the workhorse): board reports, finance, marketing reviews, churn models, almost every dashboard. The warehouse loads overnight; the business runs on it. This rung covers the large majority of decisions in a typical company.
- Hourly / near-real-time: operational monitoring - today's orders, campaign spend pacing, inventory alerts. Worth it where someone acts within the hour.
- Streaming (seconds): fraud detection, live personalization, logistics tracking. Real engineering, real on-call, real money - typically 5-10x the cost of batch for the same data. Buy it per use case, never as a platform-wide default.
Live"Zero-ETL" and other claims to hear skeptically4 min▶
Two phrases from the 2026 vendor floor deserve a leader's raised eyebrow:
- "Zero-ETL": usually means the vendor moves raw data automatically between their own products. Genuinely convenient - but the modeling, definitions, and quality work of a2-a3 does not disappear; it just stops being visible on the diagram. Nobody has automated deciding what "active customer" means.
- "Real-time by default": ask what the default costs at your volume, and which of your decisions consumed the freshness. Paying streaming prices for daily decisions is the a5 amber band in a new outfit.
- The lakehouse convergence (the real trend): warehouses and lakehouses are genuinely growing together - warehouses read open lake formats, lakehouses add governance. Directionally true and good for buyers: it keeps exit doors open. The label on the box matters less every year; the discipline inside it does not change.
The streaming bill for a daily decision. A subscription company built a beautiful streaming pipeline so the exec dashboard updated live. Cost: roughly 8x the batch equivalent. A year in, the team audited usage: the dashboard was opened each morning, once, with coffee. The pipeline was moved back to hourly; nobody noticed except finance. The lesson stuck as a one-liner: pay for the freshness the decision uses, not the freshness the demo showed.
Crawl, walk, run - and what to ask quarterly 8 min live
Everything in this track compresses to one strip. Companies that skip crawl to buy run-stage tools get the a4 lakehouse story; companies that stay in crawl forever starve their AI ambitions. The skill is knowing which stage you are in and funding the next one, not the flashiest one.
LiveFour questions to ask your team quarterly4 min▶
- "Which stage are we in, and what moves us to the next?" Forces an honest self-placement and a concrete gap list - the answer should name deliverables, not tools.
- "Which definitions did we test this quarter?" The walk-stage heartbeat. If the answer is none, your AI ambitions are drifting toward the failed-copilot demo.
- "What is the freshest data any decision actually consumed?" Keeps real-time honest: if nothing used sub-daily freshness, nothing should be paying for it.
- "If we pointed an AI agent at the warehouse tomorrow, what would embarrass us?" The best audit question of the AI era - it surfaces the two-definitions problem, stale tables, and ungoverned corners in one sentence.
Self-studyWhere to go from here3 min read▶
This closes the leader track: a1-a3 gave you the why (workloads, star schemas, one truth), a4-a5 the buying and running (engines, contracts, cost), and a6 the future (AI serving, real-time judgment, the roadmap). Three good next doors:
- The builder track of this course (b1-b10): the same Daybreak story hands-on - a real columnar engine in your browser, from raw source to served answer. Skim b1 even as a non-coder; you will recognize everything.
- learn-data-engineering: the pipelines that feed the warehouse - where the data comes from and how it arrives on schedule.
- learn-ai-governance: the oversight layer for the AI systems this session put on top of your warehouse - risk tiers, obligations, and the questions regulators ask.
Take this back to your desk ◐ 20 min
- Place your company on the crawl-walk-run strip, then ask your data lead to place it independently. A one-stage disagreement is normal and worth an hour's conversation.
- List every AI initiative currently proposed or running in your org, and for each ask: which warehouse tables does it depend on, and who owns their quality?
- Find one thing your company pays real-time or hourly prices for, and apply the filter: who acts on it within minutes, and what do they do differently?
- Ask the embarrassment question in your next data review: "if we pointed an AI agent at our warehouse tomorrow, what would embarrass us?" Write down the first three answers - that is your data-quality backlog, pre-prioritized.
- Put the four quarterly questions in your calendar for next quarter's review. The track's value compounds only if the rituals survive the course.
Official sources covered
The leader track distills the strategy layer of the major curricula - serving, freshness, and roadmap judgment, without the pipeline labs. This session covers:
Three questions before you go 🎯 ◐ 90 seconds
1 · Why does putting an AI agent on top of the warehouse RAISE the stakes on data quality?
A human notices when a chart looks weird. An agent grounded in stale or double-defined data just answers. The a1-a3 definition work was secretly your AI-readiness program.
2 · A team requests streaming freshness for the executive revenue dashboard. The leader's filter question is...
Capability and price come second. Most decisions are fine at daily; streaming costs 5-10x batch. A named person with a named minute-level action justifies the rung - "nice to see" does not.
3 · Your company has one daily-loaded star schema, one mart, and definitions written down but not tested. The right next investment is...
That description is the end of crawl. Each stage earns the next: run-stage AI on untested definitions produces the failed copilot demo. Fund the next stage, not the flashiest one.