Learn DataOps with Phoebe

Two tracks from data-that-breaks to data-that-ships

DataOps is not about typing pipelines - it is about making any change to your data safe to ship, whoever (or whatever) wrote it. A leader track teaches you to think, question, and fund that without a line of code. A builder track grows one real data product, RetailPulse, from a raw CSV into a fully governed pipeline - CI/CD, orchestration, data tests, database migrations, a monitored model, a prod release - so that by the end you can review a change an AI agent generated and tell whether it is safe to merge. DevOps basics, data CI/CD, MLOps and DBOps, on an open-source stack with AWS mapping notes.

2tracks
14sessions
4pillars
1running project

The leader track 🀝 · for C-level, managers & data leads · 6 x 45 min · no code, ever

Thinking mode: what DataOps is, why fragile data costs money, how mature your org is, and how to make the build-buy-fund calls - each session ends with questions to ask your data team on Monday.

The builder track πŸ› οΈ Β· for practitioners: DA Β· DE Β· DS Β· ML Β· 8 x 45 min Β· open-source stack + AWS notes

One growing artifact: RetailPulse, a retail sales data product. The atomic unit of this track is the diff - one reviewable change that can touch code, schema, data expectations, and a model at once, and either passes every gate or does not. Every session adds one more thing a single safe change can now move. You build each capability by hand first, so when a machine writes the next one, you are the one who can read it.

🧱 Builder 1 · easy

Foundations: repo, Git flow, CI, Docker

Scaffold RetailPulse, wire pre-commit and a GitHub Actions pipeline that lints and tests every PR, and containerize it.

β–Ά Builders start here
πŸŒ€ Builder 2 Β· easy

Orchestration: pipelines as code

Turn a script into an Airflow DAG - tasks, schedules, idempotency, backfills - with a Dagster comparison and env config.

RetailPulse v0.2
βœ… Builder 3 Β· medium

Data testing and contracts

Great Expectations and dbt tests, a data contract for the sales table, and a quality gate that fails the PR on breach.

RetailPulse v0.3
πŸ—„οΈ Builder 4 Β· medium

DBOps: schema migrations that never break prod

Version the database with Flyway/Alembic, run migrations in CI/CD, and rehearse the expand-contract rollback.

RetailPulse v0.4
πŸ”¬ Builder 5 Β· hands-on

MLOps I: experiment tracking and the registry

A demand-forecast model with MLflow tracking, a model registry, reproducible runs, and model CI that gates on a metric.

RetailPulse v0.5
πŸš€ Builder 6 Β· hands-on

MLOps II: deploy, monitor, retrain

Serve the model with FastAPI + Docker, watch for drift with Evidently, and wire the trigger that says retrain now.

RetailPulse v0.6
πŸ“‘ Builder 7 Β· hands-on

Observability, secrets and IaC

Pipeline logs and metrics, freshness and volume alerts, secrets done right, and Docker Compose that stands the stack up.

RetailPulse v0.7
πŸŽ“ Builder 8 Β· hardest

Full CD to prod: the capstone

Promote dev -> staging -> prod, release data, model and database together safely, tag v1.0, and run the graduation checklist.

RetailPulse v1.0
easy - everyone medium hands-on / deciding hardest

Choose your path πŸ—ΊοΈ

Two doors, one course. Leaders never see a terminal; builders never sit through strategy they have not first felt break in a pipeline.

🀝 Leader (no code, ever) a1β†’ a2β†’ a3β†’ a4β†’ a5β†’ a6
πŸ› οΈ Builder (grow RetailPulse) b1β†’ b2β†’ b3β†’ b4β†’ b5β†’ b6β†’ b7β†’ b8
🌱 Curious follower (a taste) a1β†’ a2β†’ b1
πŸš€ Full journey (fund AND build) a1-a6β†’ b1-b8

The knowledge map 🧠

Both tracks at a glance - hover a session to spotlight its concepts, click any node to jump in.